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FOREWORD 


THE PRESENT book, together with its companion volume devoted to 
the differential and integral calculus, contains the fundamental part 
of the material dealt with in the larger courses of mathematical 
analysis. Included in this volume are general problems of the theory 
of continuous functions of one and several variables (with the 
geometrical basis of this theory), the theory of limiting values for 
sequences of numbers and vectors, and also the theory of numerical 
series and series of functions and other analogous infinite processes, 
in particular, infinite continued fractions. 

Chapter I, “The arithmetical linear continuum and functions 
defined there” (authors: L. A. Lyusternik and Ye. K. Isakova), 
is devoted to real numbers, the arithmetical linear continuum, li- 
miting values, and to functions of one variable. The material of this 
chapter is more or less that which is usually called the introducticn 
to mathematical analysis. 

Chapter II, “n-dimensional spaces and functions defined there” 
(L. A. Lyusternik), effects the transition from functions of one 
variable to functions of n variables, which, geometrically, corresponds 
to the transition from the arithmetical linear continuum to n-dimen- 
sional space E,,, the fundamental theory of which is given. §1 is devoted 
to the fundamentals of n-dimensional geometry and, in particular, 
of the theory of orthogonal systems of vectors in £,, which serves 
as a simpler model for the theory (Chapter IV) or orthogonal systems 
of functions. §2 is devoted to limiting values in E,, to continuous 
functions of m variables and their systems (transformations in £,). 
In this chapter also §3 deals with a subject which plays an important 
part in pure and applied mathematics, the theory of n-dimensional 
convex bodies. 

Chapter III, “Series” (authors G. S. Salekhov and V. L. Danilov), 
consists of the theory of series and practical methods of summation. 

The theory of numerical series is dealt with in §1 including ques- 
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tions relating to infinite products, double series and the summation 
of convergent series. Side by side with the classical material the reader 
will find new results about the general tests for the convergence of 
series and estimations of the remainder. 

The more important classes of series of functions are considered 
in §2: power, trigonometrical, and also asymptotic power series, 
and their convergence. At this point some methods for the general 
summation of divergent series are added. In §3 are to be found various 
devices useful in calculations connected with the theory of series. 

Chapter IV “Orthogonal series and orthogonal systems” (authors 
A. N. Ivanova and L. A. Lyusternik), contains the general problems 
of the reduction of functions to orthogonal (and also biorthogonal) 
series. Here, also, general orthogonal systems of polynomials and 
the classical systems of Legendre, Chebyshev, Hermite Polynomials, 
and others, are considered. 

Chapter V “Continued fractions” (author A. N. Khovanskii), 
deals with that branch of analysis which occupied the attention 
of the greatest mathematicians of the eighteenth and nineteenth 
centuries, but which was afterwards unjustly forgotten. Continued 
fractions did not find a place in the contemporary larger courses of 
analysis; on the other hand comparatively recently, some elements 
of the theory of continued fractions were studied even in middle 
school. In the past few years the interest in continued fractions has 
revived in connection with their application in computation and 
other topics in applied mathematics. 

Chapter VI, “Some special constants and functions” (authors 
L. A. Lyusternik, L. Ya. Tslaf and A. R. Yanpol’skii), has more of 
the nature of a manual (in the narrow sense of the word). The mate- 
rial here concerns various constants, the most important systems 
of numbers, including Bernoulli and Euler numbers, some discon- 
tinuous functions, and the simpler special functions (elliptic integrals, 
integral functions, the gamma and beta functions, some Bessel 
functions, etc.). These functions, together with orthogonal polyno- 
mials, after the elementary ones, are the most widely used in appli- 
cations of mathematics. We would like to mention that these special 
functions will be dealt with more fully and in the complex domain 
in one of the following issues. 


CHAPTER I 


THE ARITHMETICAL LINEAR 
CONTINUUM AND FUNCTIONS 
DEFINED THERE 


§ 1. Real numbers and their representation 


1. Real numbers 


All real numbers can be split into two classes: rational and irra- 
tional, All integers and fractions (positive, negative and zero) are 
rational numbers, while the remaining numbers are irrational. 

The set of all rational numbers is everywhere dense, i.e. between 
any two distinct rational numbers a and b (a<)b) there is at least 
one further rational number c (a<c<)), i.e. in fact, an infinity of 
rational numbers. 

Examples of irrational numbers are: V2 = 1-41421356..., m= 
= 3-14159...,e = 2°7182818...— the base of natural logarithms, andso 
on. Irrational numbers consist of algebraic and transcendental numbers. 
Algebraic irrational numbers are defined as all non-integral real 
roots of the algebraic equation 


xX + ax" +... + dnixt+dy, = 0, 


where a, (i= 1, 2,...,m) are integers; for example, the roots 
x = 3/10, x =3/g of the equations ~—10 = 0, x*—8 = 0, the 
roots of the equation x° — 3x4 — 2x7 + x?+ 1 = 0,andso on. The remain- 
ing irrational numbers are described as transcendental; examples 


of these are 2, e, e”, 2v2 log n (where n is any integer not equal to 
10") and so on. 
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2. The numerical straight line 


We choose on a Straight line £,, an origin of measurement — the 
origin of coordinates 0, a scale the unit of length, and a direction — 
the orientation. We associate with every real number x a point A(x) 
on the line £,, having the coordinate (abscissa). x, conversely, with 
every point A(x) on £,, we associate a real number x — its abscissa. 
E, is called a numerical straight line or a one-dimensional coordinate 
space (see Chapter II for n-dimensional coordinate spaces E,). 

The number 

_f§-a for a<0O, 
lal= | a for a=0 


is called the absolute or numerical value of the number a. 
The following relationships hold: 
lja+b| s|a|+|d|, 
ja—b| =||a|—|5]|, 


ja. b| = |a].|b|, 
a|_ lel 
bj} [bl 


The number {a—)b] is called the distance between the points a and 
b on the straight line E, (see Chapter II, § 1, sec. 1). 


3. p-adic systems 


Every real number is expressible as a decimal fraction, i.e. has a 
definite expansion in the decimal system of numeration. The decimal 
system is a particular case of a positional system to the base p, where 
any positive integer p > 1 can betaken as the base. The numbers 
0,1, 2,..., p—1 are called the digits of this system, while p* 
(k = 0, +1, +2, ...) are units of the kth order in the system. 

Every positive integer N is uniquely expressible in the form 


n 
N = app°+a,p'+...+a,p" = > a;,p, (1.1) 
ies() 
where a, are digits. Equation (1.1) is written as 


N = Qn Gn—1An—s eee Q1Qp. (1.1’) 
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Similarly, any positive real number S, rational or irrational, is 
expressible as a fraction to the base p: 


nr 


S= Do ap’, (1.2) 


k=—co 


which is written as 
S = Anan} ‘onei ce Q1Q5 A_,A_»a_3 ae ae (1.2’) 


If S is an irrational number, it is uniquely expressible by an infinite 
non-periodic fraction to the base p of the form (1.2) (or (1.2’) ). 

If S is rational, it is expressible as an infinite periodic fraction to 
the base p, e.g. the number S = 1/6 is written in the decimal system 


as 
S = 01666... = 0°1 (6). 
In the binary system, S = 1/6 is expressed by the infinite fraction 
1 1 


S = 00010101 ... = 00(01) = etazt sates 


Rational numbers to the base p are numbers expressible as fractions 
with denominator p* (k = 1, 2, —2°...); each such number has two 
forms in the system to the base p: one with O repeated, the other 
with p—1 repeated. 


Le : : 
For example, the number S = > is written in the binary system as 


S = 0°1000 ... = 0°1 (0), 
S= 00111... = 00(1); 
and in the decimal system as 
S = 0°5000 ... = 0°5 (0), 
S = 0°4999 ... = 0°4(9). 
Having selected one of these forms for rational numbers to the 
base p, say the first — with 0 repeated, we obtain a unique form for 


rational numbers to the base p as infinite periodic fractions to the 
base p, and at the same time a unique form for every real number. 


The elements of various p-based systems were to be found in antiquity in diffe- 
Tent nations, and traces have been preserved into modern times in certain 
languages, e.g. of p = 12 (dozens and grosses), p = 20 (traces of this system have 
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been preserved in French), p = 40 (“forty times forty” refers to number of chur- 
ches in Moscow (Trans.)), etc. The system to the base 60 was well developed; it 
Originated in ancient Babylon (traces are retained in measurement of angles and 
time). The 60-base system must have competed with the decimal in the Middle 
Ages in the Near East and Central Asia. The decimal system originated in 
India, was further developed in Central Asia, and passed from there into 
Europe. 


At the present time the binary system is widely used in computers 
(together with the related systems having powers of two as base: 
p = 2k, k => 1 an integer). A system of numeration to the base three 
is used in the Moscow State University ‘‘Setun” computer. A set of 
numbers different from 0, 1, 2, ..., p—1 is occasionally used for 
the p digits of the system to the base p. For instance, a convenient 
choice of digits in the system to the base 3 is —1, 0, 1. The digits 
~—1 and 1 can be used in the binary system. 


Non-homogeneous positional systems are more general; here, the ratios of 
units of different orders are different numbers. Such systems were used (before 
the introduction of the metric system) for representing ‘‘denominate” numbers, 
i.e. for representing magnitudes such as length, weight, etc. For example, the 
following system of units was used for measuring weight in pre-revolutionary 
Russia: 1 pud (16 kg) = 40 funtov, 1 funt (= 400 g ) = 32 lota, etc. 


4. Sets of real numbers 


We shall discuss various sets of real numbers — for example, the 
set of natural numbers: 1, 2, 3, 4,...,m,..., the set of all proper 
fractions, the set of all rational numbers, the set of all real numbers 
between 0 and 1, etc. 

The numbers are called the elements of the set in question. 


One can consider sets of elements of any kind, and not merely sets of real 
numbers. For instance, the set of points of a plane, the set of trees in a district, 
etc. The elements of these sets are respectively points of a plane, trees, etc. 


Sets are denoted in this book by capital letters: M, N, A, B, X, 
Y, etc., or by the symbol {x,}, where x, are the elements of the set 
(countable sets). The set of numbers satisfying the inequalities 
a<x<b (a, b are numbers) is called an interval and is written as (a, 5). 
The sets of numbers satisfying the inequalities x<a, x>b, are called 
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infinite intervals and are written as (— -, a) and (b, + ~) 

respectively. The set of numbers x satisfying the inequalitiesa = x =b 

is called a segment (or closed interval), and is written as [a, 5]. 
The sets of points x satisfying the inequalities 


asx<b, a<xab, 


are called semi-intervals and are written respectively as [a, b), (a, 5). 

The infinite semi-intervals (—o, a] and {b, +) are similarly 
defined. 

The interval (x—e, x+6), (€ > 0) is called an e-neighbourhood of 
the point x. 

If an element x belongs (does not belong) to the set X, this is written 
symbolically as x € X¥(x€ X or x ¢ X). 

If all the elements of a set XY are simultaneously elements of a set 
Y, X is said to be a subset of the set Y, and we write symbolically: 
X c Y. Otherwise, X is not a subset of Y, and we write this symbol- 
ically as ¥ Cc Y(or X ¢ Y). For example, 


= € (0, 1), aé [a, b), a € (a, b), b € (a, 5); 


(0, 1I)c (0, 1), [1, 2]}c¢ 0, 1), (, 5) Cc fa, 5). 


The set M of all the elements that belong both to a set A and a 
set B ts called the intersection or product of the sets A and B, and is 
written symbolically as 


M=AQB (M=AXB=A.B= AB). 
For example, 


0, n=|-7. 1]n@ 2), b= (a, BNIB, ¢) 


and so on. 

The set M consisting of all the elements that belong either to a set 
A or toa set Bis called the union or sum of sets A and B, and is denoted 
symbolically by 

M= AUB (M = A+B). 
For example, 


(0, aula: +=] =(0, +), (-3, UG, 8] =(-3, 8}. 
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The set M consisting of the elements of a set B that do not belong 
to a set A is called the complement of the set A with respect to the set 
B or the difference between the sets A and B, and is written symboli- 
cally as 

M = B\A (M = B-A). 


For example, 


(7, 8] = (5, 8]\(—3, 7], (0, 2/0 z = E 2) etc. 


The notation B\A is employed in more general cases. 


5. Bounded sets, upper and lower bounds 


A set X of real numbers is said to be bounded from above (below) 
if there exists a number M (m), not less (not greater) than all the 
numbers x € X. The number M&M (ym) is called an upper (lower) bound 
of the set X. 

A set X is said to be bounded if it is bounded from above and below. 
For example, the set (— ©, 0) is bounded from above, the set 
(0, +) bounded from below, while (0, 1) is a bounded set. 

The least (greatest) of all the upper (lower) bounds of a set Y is 
called the strict upper (lower) bound M* (m*) of the set X and is 
written symbolically as 

M* = supx (m* = inf x). 
xEexX x€X 
The numbers M* and m* possess the following properties: 
(1) The inequalities hold for all x € X: 


M* =x, m* sx. 


(2) Whatever the number ¢ > 0, a number x, € X can be found 

for which, respectively, 
Xo = M*—e&, xo m*+e. 
For example, 
sup x=), inf x= 0. 
x € (—©, 0) x € (0, x) 

(3) If the set X = {x} is bounded from above (below), it has a 

strict upper (lower) bound. 
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The concepts introduced below (§ 2, sec. 2) of strict upper and 
lower bounds of a function are particular cases of the strict upper 
and lower bounds of a set. 


6. The theory of irrational numbers 


Precise irrational number theories, due to Dedekind, Cantor and 
Weierstrass, made their appearance in the second half of the nineteenth 
century, in connection with the critical consideration of the funda- 
mental concepts of analysis. 

Dedekind’s theory. 

The set of all rational numbers with all their properties is assumed 
given. The set of all rational numbers is divided into two classes A 
and A’. This division is called a section in the rational number domain 
if the following conditions are satisfied: 


(a) every rational number falls into one and only one of the sets 
A and 4’. 

(b) every number a of the set A is less than every number a’ 
of the set A’. 


The set A’ is called the upper class, and the set A lower; a section 
is denoted by A]/’. 

Sections can be of three types: | 

(1) either there is no greatest number in the lower class A, while 
there is a least number r in the upper class 4’; 

(2) or there is a greatest number r in the lower class A, while 
there is no least in the upper class A’; 

(3) or there is no greatest in the lower class, and no least in the 
upper class. 

We say in the first two: cases that the section is performed by the 
rational number r (which is the boundary between the classes A and 
A’), or that the section defines the rational number r. In the third case 
the section A|A’ defines no rational number; we say that a section of 
type (3) defines some irrational number «. 

For example, if all the numbers a = 0 are referred to class A, 
as also the numbers a > 0 for which a2 < 2, while all the remainder 


are in class A’, the section 4| A’ defines the irrational number “2. 
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All real numbers can be ordered in the following way: two irrational 
numbers « and f, defined by the sections A|A’ and B|B’ respect- 
ively, are reckoned equal if the sections 4] A’ and B| B’ are iden- 
tical, and conversely, if the sections A | A’ and B| B’ coincide, the 
respective irrational numbers are said to be equal. We say that 
the numbera > fif the class 4 wholly contains the class B, which 
does not coincide with 4, anda > r, where 7 is any rational number 
of the class A. Hence only one of the following relationships is possible 
for any two real numbers « and 8: « = £B,a <f,a> 8. 

If sections are performed as described above in the domain of real 
numbers, it turns out that there always exists for any such section 
A|A’ a real number accomplishing the section. This is the essence 
of Dedekind’s basic theorem. This property of the set of all real 
numbers is described by saying that it is complete or continuous. 

We can introduce for real numbers the concepts of the arithmetical 
operations and laws (addition, multiplication, division by a non-zero 
number, etc.). For instance, the sum of two real numbers a and # 
is taken to be the real number y = a + £ which satisfies the relationship 
at+b<«<y<a'+b’, where a, a’, b and b’ are all possible rational 
numbers satisfying the inequalities: a<a<a’,b<fp< bd’. 

All the other arithmetica] operations can be similarly introduced, 
while retaining the fundamental properties. 

Cantor’s theory. We take all possible fundamental sequences (see 
§ 3, sec. 2) of rational numbers. A sequence of rational numbers, 
convergent to a rational limit, is fundamental. At the same time, there 
exist fundamental sequences of rational numbers which do not have 
rational limits, as for instance the sequence of decimal approximations 
{l; 1°4; 1-41; ...} of the square root of two. 

Two infinite sequences {x,} and {y,} are said to be eguivalent 
or confinal if |x,—y,,| tends to zeroas m+ eo. This means that two 
equivalent fundamental sequences {x,} and {y,} can only have 
the same rational limit x as m— oo. All equivalent fundamental 
sequences of rational numbers are referred to one class — the equi- 
valence class, and the set of all fundamental sequences of rational 
numbers is divided into equivalence classes. 

There are two possibilities: either there exists a rational number 
r, the common limit as n + of all sequences {x,,} of the same 
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equivalence class X, or there is no such number among all the rational 
numbers. 

We say in the first case that the equivalence class X defines the rati- 
onal number r; in the second case, we say that the equivalence class 
X defines an irrational number x (which is also regarded as the limit 
of the sequences of the class X as n + oo), Every equivalence class 
defines a real (rational or irrational) number. 

Arithmetical operations may also be introduced for all rea] numbers. 
For example, the sum x+y .of two real numbers x and py is taken 
to be the number which is defined by the class ¥+Y, where LY is the 
equivalence class defining the number x, and Y the equivalence class 
defining the number y, the sum X¥+/Y being understood as the class 
to which sequences of the form {x,+y,} belong, where {x,} is any 
sequence of X, and {y,} any sequence of Y. 

All the other arithmetical operations on real numbers may be simil- 
arly introduced. 

A real number x is said to be positive (x >0), if the corresponding 
equivalence class X contains a fundamental sequence of positive 
rational numbers not convergent to zero. 

The inequality > 8, where aand £ are two real numbers, means 
that ~<—f > 0. 

The concepts of fundamental sequence and equivalence class can 
also be defined on the set E, of all real numbers. It turns out that 
all fundamental sequences are convergent on E, (see § 3, sec. 2), 
so that any equivalence class on E, defines a real number — the 
common limit of sequences convergent to it. No new numbers can 
be obtained with such a completion of the set Z,; in this sense, the 
set E, 1s complete. 

Thus the real number set £, is obtained as a result of completion 
of the set of rational numbers by the limits of all possible fundamental 
sequences-of rational numbers. This idea of completion has acquired 
great value in functional analysis. 

As regards other irrational number theories, we may mention, 
in addition to Weierstrass’s, A.N. Kolmogorov’s argument (see 
ref. 6, p. 269) and the axiomatic construction of the real numbers 
(see ref. 4, p. 157, and ref. 15, p. 180). 
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§ 2. Functions. Sequences 


1. Functions of one variable 


If we are given a set of real numbers X = {x}, and each number 
x € X is associated with a corresponding number y, where Y = {y} 
is the set of all such y, the function y = f(x) is said to be defined 
on the set X. The set X is called the domain of definition of the function 
f(x), and every number x € X the argument. The set Y is called the 
range of the function f(x). If the argument x is given, the value y = f(x) 
of the function is given. For instance, for the function y = x? the sets 
X and Y coincide with the real axis £,; for the function y = tan x 
the set Y is the whole of the real axis £,, while X¥ = E,—M, where 


M is the set of all numbers of the form — a+ na (x =O, se) te 2 ees)5 


for the function y= x! the sets Yand X are the sets of natural numbers; 
for the function y = E(x) (the integral part of x), X is the real line 
E,, and Y is the set of natural numbers. For the function 


—-l1 for x<0O, 
sign x = 0 for x=0, 
1 for x>0 


the set X is the real line, while the set Y consists of three numbers: 
—1, 0, 1. 

Any finite set of numbers {a,;} (i = 1, 2, ..., m) can be regarded 
as a function, given on the finite set of natural numbers X < {1, 2, 
..., ”} and associating with each of these numbers i the value of the 
function f(i) = a, (i = 1, 2, ..., 7). 

The concept of a function has been subjected to wide generaliza- 
tion. X can be a set of arbitrary elements. A numerical function 1s 
said to be given on this set if a number f(x) is associated with every 
element x of the set. 

We shall consider in Chapter II functions defined on a set of 
points (or vectors) of n-dimensional space. The area bounded by a 
polygon, or its perimeter, can be regarded as functions defined on 
a set of plane polygons; physical magnitudes, such as the mass of 
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a body, its charge, etc. are defined on the set of corresponding physical 


bodies, etc. 
The elements of a set X, on which a function is defined, are occa- 


sionally called points. 


2. Upper and lower bounds of a function 


An upper (lower) bound of a function f(x), defined on a set X, is 
a number M(m) such that f(x) = M(f{(x) = m) for all x € X. If this 
number exists, the function f(x) is said to be bounded from above 
(below) on X. A function, bounded from above and below on X, 
is said to be bounded on X. 


The least (greatest) of all the upper (lower) bounds of a function 
f(x) is called the strict upper (lower) bound M*. (m*) of the function 
and is written as 

M* = sup f(x) ae = inf I). 

xex xe xX 
If there exists an element x, (x,) of X, for which 
f (Xo) = sup f(x) ( f(%;) = inf I), 
xe X xeXx 

then 

sup f(x) = f(x) ( inf f(x) =f ()} 

xe Xx xEeXx 


is called the absolute maximum (minimum) of the function f(x) and 
is written as 


f(Xo) = sup f(x) = max f(x) (s (x) = inf f(x) = min Ie). 
xe Xx xe s xéeXx xe X 
In this case, we say that f(x) attains its absolute maximum (minimum) 


at the point X,(x;) 
Given the finite set a,, a,...,4,, we write 


max {@), de, ..., an} Gu {ay, a, ..., an}) 
nr nr 


for the maximum (minimum) of the numbers a, a, ..., 4,. 
For example, 


inf —=0, minsinx = —1, max sinx = 1, 
XE (0,00) X x€ Ey xe By 


max {4, 3, 7, 11, 8} = 11, min {4, 3, 2, 10, 17}= 2. 
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The following inequalities hold: 
(1) sup f(x)+ sup f(x) = sup (4) +A), (1.3) 
x€EX x€EA xe xX 
inf f(x)+ inf f(x) = inf (fO)4+A(X)). (1.4) 
xe X xe X xe X 


If f(x), f,(x) and f,()+/() attain a maximum (minimum) on X, 
then we have 


aes F(x) + sae A(x) = pg (fi)+A), (1.3a) 
min f(x)+ min f\(x) S min (f(~)+f,(0)). (1.4a) 
x€X xexXx xe Xx 


The sign of equality holds in (1.3a) (or in (1.4a) ) when f{x) and 
A(x) attain a maximum (minimum) at the same point. 
For example, 


max sin x+ max cos x = 2 > max (sin x+cos x) = ,/2. 
x € Ey x € Ex =€ Ey 


(2) If Yc X (the set Y is part of the set X), we have 

| sup f(x) = sup f(x), inf f(y) = inf fo). 
yveY xEx veY x€ X 
For example, 
max sinx = v2 max sinx = 1, 
we [o, =] x€ Ey 
max (3, 11, 15, 8) = 15 > max (3, I, 8) = 11. 
The following notation is often used, 
(f=), Sa<a, Cems, G@>, UO) 24) 


and similar ones, to denote the sets of points x for which the respective 
inequalities are satisfied (they are called Lebesgue sets). 


For instance, (x? < 2) is the interval (=4/ 2, xf 2); (sin x = 1) is 


the set of numbers {on 1) 7 , where » is any integer. 
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3. Even and odd functions 


Let us consider functions defined on the real axis or on the segments 
[—a, a] and intervals (—a, a) (in general on a set M, symmetric with 
respect to the origin). 

A function f(x) is said to be even if f(—x) = f(x) for any x of 
its domain of definition, and odd if f(—x) = —/f(x). All even powers 
x2" are even functions, and all odd x?"+! are odd functions. Other 
examples of even functions are cos x, |x|, and of odd: sin x, tan x, 
etc. 

A sum of even functions is even, and of odd, odd. The product of 
even functions is even; the product of an even number of odd functions 
is even, and of an odd number, odd. For example, sin x tan x is 
an even function, x sin x tan x is odd. The product (and quotient) 
of an odd and even function is odd. For example, |x| sin x is odd. 

A constant is an even function. 

Any function of an even function is an even function, e.g. e!*!, 
sin (cos x) are even functions. An even function of an odd function 
is an even function, e.g. cos (sin x). An odd function of an odd func- 
tion, is an odd function, e.g. tan (sin x). 

Any function f(x) is expressible as the sum of an even function 

f(x) and an odd function f,(x): 


F(x) = A) +A), 


where 


AC) = 5 UO+A-M1+¢ 


Ale) = + U@)-f-91-C 


(C is a constant). 


4. Inverse functions 


Given two sets X and Y, each element x € X being associated with 
some element y = A(x) € Y, a mapping (or correspondence) A of 
the set X into the set Y is said to be given. 
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If y = A(x), y € Y is called the image of the element x € X, while 
x is the pre-image of y. 

If a unique element x € X corresponds as pre-image to each element 
y € Y, the mapping (correspondence) A is called a one-to-one mapping 
of X into Y. 

EXAMPLE 1. Let all the houses of a street be numbered by the 
integers from 1 to 80. We have a one-to-one correspondence 
between the set of houses and the set of the first 80 natural numbers. 

EXAMPLE 2. Let E’ be the set of all non-zero real numbers; one of 
the two signs + or — is associated with each number x € E’. We 
have a mapping of E” into the set of signs consisting of two elements; 
the pre-images of the sign + (—) are all positive (negative) numbers. 

Let the sets X and Y be sets of the numerical axis E,; the mapping 
A = f(x) of the set X into Y is some function y = f(x), defined on 
the set X, with the domain of values Y. 

If the function y = f(x) is a one-to-one mapping of the set XY into 
the set Y, we say that there exists for the function f(x) the inverse 
function x = g(y), which maps the set Y into the set X. The set Y is 
the domain of definition of the function x = g(y), while the set X 
Is its range. 


EXAMPLE 3. y = sin x, xX = arcsiny, X = |-5* 5*|. 
] ] 
EXAMPLE 4. y = tan x, x = arctan y, X = |-3* =|. 


EXAMPLE 5. y = e (k #0), x = (l/k)log y, X= E,. 


5. Periodic functions 


A function f(x) is called periodic if a number w>0 exists such 
that, for any x, 
S(x+o) = f(x). (1.5) 
The number @ is called a period of the function f(x). If w, and 
W, are periods of f(x), w;-+@z is also a period of f(x). 
The least of all such positive numbers w is called the /east period 
(or simply the period) of the function /(x). 
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THEOREM 1. If a continuous (see § 3, sec. 11) function f(x) is periodic 
and differs from a constant, then it has a least period W, > 0, and all 
its remaining periods are multiples of wp. 

For instance, when f(x)'= sin x we have wy) = 22, when f(x) = 
=|sin x| the periodw, = 2, and when f(x) = E(x) (see § 2, sec 1) 
the period wy = 1. 


6. Functional equations 


A functional equation is an equation connecting different values 
of functions; we say that a function, for which such an equation 
holds, is a solution of the functional equation, or, that the functional 
equation is satisfied by it. 

EXAMPLE 6. Solutions of the functional equation 


Lx+y) =f) +f) (1.6) 


include the linear functions 
I(x) = kx (kK is a constant). 


It can be shown that they are the only continuous functions satisfy- 
ing this functional equation. 
EXAMPLE 7, Solutions of the functional equation 


F(x) -fO)j= f+) (1.7) 


include the exponential functions a*(a = 0), these being the only 
continuous functions that satisfy this equation. 
Notice that periodic functions satisfy the functional equation 


f(x+o) = f(x). 
We can also discuss systems of functional equations. For instance, 
the pair of functions 
f(x) = sin x, 9) = cosy 
(and the pair of functions f(x) = 0, 9(x) = 0) is the unique con- 
tinuous solution of the system of functional equations 
I+) = fx)P(Y) +fO)PO), 
x+y) = A(x)e()—f()/0), 
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if we required in addition that the functions be positive in the interval 
(0 5" and that the conditions f (5*) =I,9 (37) = 0 be 


satisfied. 


7. Numerical sequences 


A function, defined on the set of positive integers, is called an infinite 
numerical sequence if for each positive integer n(n =1, 2, 3,...) 
there is a corresponding number x, — the n-th term of the sequence 
{x} = {X1, Xo,--+5Xyy--.}. The number nin the expression x,, 
is called the index (or subscript). We sometimes consider sequences 
{x,,} where, in addition to the natural oe n can be zero or have 
any integral value. 

We shall say that, when m>n, the term x,, follows the term x,, 
(x, precedes x,,), independently of the actual piapainide of the numbers 
x, and x,,. A sequence is regarded as given if a relation is known 
for forming the terms of the sequence. It is often possible to find 
an expression (formula) for the general term x,, of a sequence. 

EXAMPLE 8. Arithmetical progression 


Xn = a+(n—))a. 
EXAMPLE 9. Geometrical progression 
x, = a9" *. 
EXAMPLE 10. Decimal approximations to the numberz=3-14159...: 
X= 335 X=31; x= 3:14; x, = 3-141; 
EXAMPLE 11, Let n=a,a,...a, be a given number in the decimal 
system, where a, @:,...,4, are digits; then the numbers x, = 


=0-4a,d.,...a, and y, = 0-a,a,_,...a, form numerical sequences 
when 2 = 1, 2, .... For example, when 


n = 15 we have x,, = 0-15; y,, =0-51. 
EXAMPLE 12. We decompose the positive integer n into prime 


factors 
m= per, pile... ple, pilesitl |. , piimtt 
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and define a sequence {x,} as follows: 
x, = ph . pe Sate pix Pp veetth) ea po (tm+1) 


with n = 1, 2, 3, 

For example, m = 18 = 21,37, x1, = 3.271 = 3/2. 

It is possible to discuss sequences of vectors, functions, etc., as well 
as numerical sequences. 


8. Upper and lower bounds of a sequence 


A sequence X = {x,} is said to be bounded from above by a number 
M if x,=M for all indices m. In accordance with the definition 
given in § 1, sec. 5, the number M is called an upper bound of the 
sequence {x,}. The sequence X¥ = {x,} is said to be bounded from 
below by the number m, if x, = m for all m. The number m is called 
a lower bound of the sequence {x,,}. The sequence is said to be bounded 
if it is bounded from above and below. 

The least /*(greatest m*) of all the upper bounds M (lower bounds 
m) is called the strict upper (lower) bound of the sequence {x,} and 
is denoted, as before, by - 


sup x, = M* and inf x, = m*. 
n nr 


The propositions of § 2, sec. 2, hold for the strict upper and lower 
bounds of a sequence {x,}. 


9. Maximum term of a sequence 


Given a sequence {u,} (k = 0, 1, 2,...), we sometimes want to find max u, — 
k 
the maximum term of the sequence {u,}, provided such a term exists; let us call it 4: 


k 


The subscript of the maximum term of {u,} is called the central subscript and 
is denoted by ». If the terms of {u,} include several that are equal to u, the greatest 
of the subscripts of these terms is taken as ». 

Ifu, = u,(x) are functions of x,x € X c E;, then» = (x), uw = u(x) are also func- 
tions of x. 

EXAMPLE 13. Given the sequence {u,(x) = x*/k!} (k = 0,1,2, ...), the number 
(x) = E(x) =n, while the maximum term u(x)=x"/n! for non-integral x; if x is 
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an integer, x = m, then »(x) = m, while u(x) = u,,_, = u,,. For example, with 
x = 6 we have »(6) = 6, 4(6) = u, = 65/5! = 65/6! 

EXAMPLE 14. Given the sequence {u,(x)=x*/(2k+1)!} (k = 0 1, 2,...), the 
index of the maximum term is defined by the inequality 


2n(2n+1) S x S (2n+2) (2n+3), 


and, with fixed x > 0, the maximum term u, corresponds to the value n = E(x). 


10. Monotonic sequences 


A sequence {x,} = {x,, X9,...,X,} iS said to be monotonically 
increasing (decreasing), if 


XS Xp Se ey SS a SX Ss 
emcee eee ks os) 
and to be non-decreasing(non-increasing), if 
Xy EX BXg BS... SXyS... 
eS Ss SS as ; at?) 


Sequences of the form (1.8) and (1.9) are described as monotonic, 
sequences of the form (1.8) being monotonic in the strict sense (or 


strictly monotonic). For example, the sequences {x,,}, where 
] 1 

—_T: xn = 5 — 3n=7> Xx, = 2+5(n—1) 

Qnis + z 


are monotonically increasing in the strict sense; the sequences {x,,}, 


where 
Pa 1 —_ 1 
a Pann’ | 2s 
are monotonically decreasing in the strict sense; the sequence {x,}, 
where 


eee See ee 
9.2 = ae a 4" 4°? a Ae eet 


is non-increasing; the sequence {x,}, where 


y= 1 xX = 


X%,=0, xm=1, x%=2, xm =2, xX5=3, X%=4,... 


is non-decreasing. 
All the above-mentioned sequences are monotonic. 
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11. Double sequences 


A double sequence {a,,,,} is a function of a pair of integral subscripts 
n and m: to each pair of integers n and m there corresponds a number 
Anum — the term of the sequence {a,,,,}. 

EXAMPLE 15. {a,,, = 1/(n?+m?)} (n, m= 1, 2, ...). 

If the numbers n and m are represented in the decimal system by 


N= QpQp_y »-- Q, (1.10) 


mz bp Op 1 eae b, 


(it can be assumed that 7 and m are represented by the same number 
of digits; this can always be arranged by putting a suitable number 
of zeros in front), we can form a double sequence {N,,,,}, where 


N= IN co = anbpap_ Op -1 eee a,b,. (1.11) 


EXAMPLE 16. If nm = 103, m = 27 = 027, then Njo3 9, = 100 237. 

Conversely, we can associate with every integer N, represented 
by the right-hand side of (1.11) (ifthe number of digits (2k—1) in N 
is odd we put the digit a,,= 0 in front), a corresponding pair of 
integers n and m in accordance with (1.10). 

We thus obtain a one-to-one correspondence between the set of 
pairs of integers and the set of all non-negative integers. 

EXAMPLE I7, Given the double sequence {a,,,} (n,m = 0, 1, 2,...), 
it can be related thus to an ordinary sequence {b,} (N = 0, 1, 2,...), 
when N = N,,,, we have by = ay, 

The double sequence {a,,,,} is said to be arranged as the ordinary 
sequence {by}. 

See Chapter III for the summation of double sequences (double 
series). 


§ 3. Passage to the limit 


1. The limit point of a set 


We call xy a limit point of a set X if there is at least one more 
point of X (different from xg) in any e-neighbourhood of the point 
Xp (€ IS any positive number). Alternatively, x, is a limit point ofa set 
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X if an infinity of points of X is contained in any e-neighbourhood 
of x9. A set may have no (or even infinitely many) limit points, 
which may or may not belong to the set. For instance, the set Y = 
={1/n}, where m = 1, has one limit point 0, which does not belongto 
the set; every point of any interval (a, 5) (as also the points a and b) 
is a limit point of the interval. 

THEOREM 2 (Bolzano-Weiestrass). Every bounded infinite set X 
of E, has at least one limit point. 

A set M 1s said to be closed if it contains all its limit points. 

For example, M = < 0, 2 2 er s vf is a closed set; 

2 3 n 

any segment [a, b] is a closed set. 

A set M in E, is described as open or as a domain if any point 
appears.in M along with its e-neighbourhood. 

For example, any interval («, 8) is an open set; any system of 
intervals is an open set. 

The real axis is an open and a closed set; on the other hand, any 
semi-interval (a, 8], [«, 8) is neither an open nor a closed set. 

The complement of an open (closed) set M with respect to E, is a 
closed (open) Set. 

For instance, the complement of the open set (— ~, 0) U (I, 
+ eo) is the closed set [0, 1]. 


2. The limit point and limit of a sequence 


The number x is called a limit point of the sequence X = {x,} 
if any e-neighbourhood of x contains at least one term x,, of X 
different from x (i.e. an infinity of terms of the sequence). 

A bounded infinite sequence X = {x,} has at least one limit point. 

The constant number x, is called a limit of the sequence {x,} if, 
given any number ¢ > 0, however small, there is a subscript N (depend- 
ing only on the choice of £) such that, for all n > N: 


We say in this case that {x,} has a finite limit x» and write lim x,, = Xp, 
N—> co 
or that {x,} is convergent to xp, and write x, Xo. The sequence {x,} 


is said to be convergent in this case. This means geometrically that, 
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given any e > 0, from some subscript N, onwards, all the points x, 
lie in the neighbourhood (x y—¢, x9+€). In particular, x,, is described 


as an infinitesimal if lim x, = 0. A sequence that has no limit is 
=> oo 
said to be divergent. 


A sequence {x,}, having the property that, given any e < 0, there 
exists a subscript N such that |x,,—x,| < ¢« foralm>N,n=N, is 
described as fundamental. 

A general criterion for the convergence of a sequence {x,} is: 

THE BOLZANO—CAUCHY CRITERION. A necessary and sufficient 
condition for the sequence {x,} to be convergent is that it be funda- 
mental, 

We say that the limit of the sequence {x,} is equal to infinity, 

lim ny, = ©, 
i> co 
if, no matter how large the number K > 0, there exists N such that, 
for al n>N, 
|x, | > K. 


If the numbers x,(m > N) are positive (negative), we write 


lim x, = + eae. Race erica 
Rl-> oo l—> co 
Some limits: 
h h=1 
1. ie ee on 2 (b 0). 
n—>eoo bnt+bnb-14+ ... +b, 5b 


n/ nip\n 
2. tim (VAtVo)" _ gg. 


N—> oo 2 


N—> oo 
4 lim Vn = 
R—> co 
; n 
5 lim =e cf. (6.36)}]. 
a [cf. (6.36)] 


6. lim —— SSS . ee, 
noo /(n+1)(n+2)...2n 4 
in, , 3/> n {_ 

7. lim 1+ y2+V3 +... +¥0 21, 


N—> co n 
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se frh-[lehy (ea) -]}-4 


9. For a => 0. 


port 0-14. 32-1 gat (tray 
n* 


lim = Q, 


N—> co 


10. If we write 


An = SSS and Gani = Naa, eee Qn-1 9 


we have, with a, = C®: 


lim 7/4, = 2, lim °/G, = Je. 
N—> co N—> co 
11. If the above notation is retained for A, and G,, we have 
with a, = a+kd(k = 0, 1,2, ...),a>0,d>0: 
G, 2 


lim —_ =“ —. 
neo Ay € 


3. Fundamental theorems concerning limits 


1°. A sequence can have only one limit. 

2°. If a sequence has a finite (infinite) limit, it is bounded (non- 
bounded). 

3°. If a sequence {x,} has a unique limit point Xo, the sequence is 
convergent and x, is its limit. Conversely, if a sequence (x,,) is convergent 
to Xo, Xo is its unique limit point. 

4°. If x is a limit point of a sequence {a,\, there exists a subsequence 
{a,,}, convergent to x. Conversely, if y is the limit of some subse- 
quence {a,,}, y is the limit point of the sequence {a,}. 

5°. Similarly, if x is a limit point of a set M of the numerical axis 
E,, M contains a sequence {x,} of numbers different from x that con- 
verges to X. 


6°. On the assumption that lim x,, and lim y,, exist, we have: 
N—> co N—> co 
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lim (x, + y,) = lim x, + lim y,, 
Tt—}» oo R=—> oo 


n— co 
lim (x,-¥,) = lim x,. lim y,, 
i= oo Ti —> co li— oo 
. lim Xp, 
lm = = *==—., where lim y, + 0: 
n—>oo Yn lim Yn cat : 
Tl—> oo 


4. Some propositions on limits 


1°. If lim a, = a and all thea, >0O(i = 1, 2,...), then 
> co 


Aat+tant+t... +a, 


ni-> oo l=» oo 
2°. If A is the greatest of the numbers 


Gy, Gg, ».+; An (a; = 0) 


p> 0 G = 1, 2, 3, ..., n), 


lim "Vpay'+ pray + ... +pram = A, 


m—> oo 
lim 222 teat et Pnan Th 
m—> co p ay" + p2a3" + ee + pray 


3°. If, for a sequence {a,}, 


and 


both exist, then 
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4°, If 


Pn 


lim ————"——— = (0, 0, 
n-rco PotPyt .-- Dn Pa = 


and, asn + oo, S, has a limit equal to s, we have 


lim SoPn + S1Pn—1 + S2Pn-ot «++ $SnDo = 
n=> ce PotPit Pot .-- +Pn 


5. Upper and lower limits of a sequence 


The upper (lower) limit of a sequence {x,} isthe strict upper (lower) 
bound of the set numbers which are limits of the sequence, and is 
written as 

lim x, ( lim *n): 
TN —> co N=» co 


For example, 


fim [c-or2] = 1, 


lim jones | = -1, 


Thi-> co 


while at the same time, 


sup | m+ | = >, 


nel, 2, eee 


inf [(—o | ee 
nml,2,... n 

Every bounded sequence has an upper and a lower limit. 

If a sequence is convergent, its limit coincides with its upper and 
lower limits; if the upper and lower limits are the same, the sequence 
is convergent to their common value. 

Given any sequence that has an upper and a lower limit, we can 
readily form monotonic sequences convergent respectively to the 
upper and lower limits: a monotonically non-increasing {x,,} to 
the lower, and a monotonically non-decreasing {x} to the upper: 
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ras 
3 
ll 


sup {Xn Xn+19 Xn+2) ae }s 


il 


Xen = inf {Xn, Xn41, Xnger ++} 


oT ‘ . : ‘ 
lim x, = lim xj, lim Xn = LM Xen. 


If {x,,} is a monotonically non-decreasing (non-increasing) sequence 


e 2 . 
and a= lim x,, then x, = X,, Xs, = Q(x, = 4, Xe, = *,). 
N-> oo 


6. Uniformly distributed sequences 


Let the sequence {x,,} lie on the segment [a, 5]. 
Let N,, («, 8) denote the number of the points x, (kK = 1, 2,..., m) 
which lie in the interval (x, 8) < [a, 5]. If the limit 


lim 


n—> co 


Nala, B) _ og = Bz 
n 
exists, then no matter what the interval («, 8) c [a, b], the sequence 
is said to be uniformly distributed on the segment [a, 5}. 
EXAMPLE 18. The sequence {y,} of EXAMPLE 11 (see § 2, sec. 7) 
is uniformly distributed on [0, 1]. 
EXAMPLE 19. The sequence {x,,}, where 


X_, = an?—[an"], a>0, O<c<1 (n= 1,2, ...), 


({x] is the integral part of x) is uniformly distributed on [0, 1]. 
EXAMPLE 20. The sequence {x,,}, where 


Xn = a(lnn)’?—[a(inn)’], a@a>0,0>1 (n= 1,2; 44); 


is uniformly distributed on the segment [0, 1]. 

Uniformly distributed sequences have applications in numerical 
integration. Obviously, all interior points of the segment [a, b] 
are limit points for {x,}, and moreover, 


a= lim x, b= lim x,. 
n—> co Ri oo 


Given any function /(x) continuous on [a, 5], and a sequence {x,}‘ 
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uniformly distributed on [a, b], the following relationship holds: 
i | 1 fe d 
Bere a = pa | x. 
Conversely, if this equation 1s satisfied for all functions continuous 
on [a, bj, then the sequence {x,,} is uniformly distributed. 


7. Recurrent sequences 


A sequence {x,} is said to be given bya recurrence formula if the 
first few terms are given and a formula is known, with the aid of 
which x,, is expressible in terms of the preceding terms: 

Xn = f(Xn-1; Xn—29 ¢ +> Xn—p)s pe ] (n = |, Se se 
For instance, x; = |, x2. = 2, x, = X,_, = X,_-,(n = 3, 4, ...). 

The sequence itself is sometimes described as recurrent. 

The simplest example of a recurrent sequence is an iterative sequ- 
ence {x,}: 

Xn = S(Xn_-3). 
Iterative, and in general recurrent, sequences are of great value in 
approximation methods — for example, in the method of successive 
approximations and Newton’s method. 

(a) The method of successive approximations for solving the equa- 
tion x = f(x), where f(x) is a continuous function, leads to an iter- 
ative sequence {x,}: 

Xai = S{Xn} (A =0, 1, 2,...), 
where some arbitrary number is taken as Xo. Here, if the sequence 
{x,} is convergent to x, x proves to be a solution of the equation: 
x = f(x). 

(b) Newton’s method (or method of tangents) for finding the roots 
of the equation f(x) = 0, where f(x) is a differentiable function, 
also leads to an iterative sequence {x,}: 

F'(Xn)Xa —I%n) = 
pe iy (kK =0 1, 2,...), 
where some number is taken as xX; here, if {x,} is convergent, then 


lim x, = x is the required root, i.e. f(x) = 0. 
h—> co 
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(See above, for a sufficient condition for the convergence of the 
sequence {x,,} indicated in method (a).). 


8. The symbols o(«,) and O(@,) 


A variable that takes a certain sequence {«,,} of values is called a 
variant. For instance, the variable term of any progression is a variant. 
If a, and 8, are given variants, while their ratio «,/B, tends to 
zero as n — a lim «,/8, = 0); we say that«,, (8,) is an infinitesimal 
N—> co 
(infinitely large quantity) with respect to 8, («,) and we write sym- 
bolically: 
Gn = 0(8,). 
For example, 1/n? = o({1/n), n = o(n?). 

If «,, 6, are infinitesimals and «, = o(f,), we say that «, (8,) 
is an infinitesimal of higher (lower) order with respect to 8, (a,), 
or «,, (8,) decreases faster (more slowly) than £,, («,). If «,, 8, are 
infinitely large quantities, and «, = o(8,), we say that a, (8,) 
increases more slowly (faster) than B, (a,). 

If |«,|=C/8,], C>0 (C is a constant), we say that 8, has a rate 
of decrease not faster than «, or that a, has a rate of increase not 
faster than B,, and we write symbolically: 


w= O(B,,). 
In particular, if lim «,/8, = C #0, then «, = O(§,) or 


I—> oo 
B, = O(@,). 
For example, n = O(V/n?+1). 
The equation 
kp, = O(1) 
implies that the sequence {«,,} is bounded, i.e. that |«,,| = C for all n. 
THEOREM 3. Given an arbitrary sequence {X,} = {x"} of the 
following sequences: 
NG ee Ay haa GS Sag a hess 
Dae 5 (moc ae. rae, Se 


>. © e@# e® oe @e@ @® e® oe e® oe oe @® e® @® @ @® @® @ @ 
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there exists a numerical sequence X = {x,} = {Xy, Xo,--+>Xpy ++} 
increasing faster (decreasing faster) than any of the sequences {x7,}. 

For example, if X, = {n™} = {nr}, n®, n',...,n™,...}, the 
sequence Y = {m!} = {1}, 2!, 3!,...,m!,...} increases at a faster 


rate than any sequence {X,,}: lim n"/m! = 0 for any n. 
M—> co 


9, Limit of a function 


Let the function f(x) be defined on some set X. We say that the 
number A is the limit of f(x) as x + Xo: 
A= lim f(x), 
x=—> Xo 
or that f(x) tends to A as xX + Xo, if, given any sequence {x,} € X, 


convergent to x, ( lim x, = Xp), the sequence {f(x,)} is convergent 
N—> eo 


to A. Or, in other words, the number 4A is the limit of the function 
f(x) as x > Xo: 
A= lim f(x) (f(x) +A as XxX — Xp), 
ex 


xX—> Xy, X 


if, given any positive number e, there exists 6 > O such that | f(x)— A |< 
<e for all x € X such that 0 < |x—x,|~< 6. For example, 


. sinx . tanx . l—-cosx ] 
lim —=1, lm —e=1]1, lim ——— =-, 
x>o 60 x—>o * x—> 0 x? 2 

lim x*Inx =0O for any a> 0. 
x—>O0 


10. Right and left continuity of a function 


We shall consider functions y = f(x), defined on sets X of £;; 
X will usually be a set such as 


fa, b}, (x, B), [a, b), (x, B), (— o, + eo), (-— oP, 0], 
[0, + oo), (— oO, 0), (0, + eo), 
etc. 
Let f(x) be defined on an interval (xo, a). The number A =f(x,+0) 


is called the limit of the function f(x) from the right at the point x»=Xp 
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if, given any sequence {x,,} of (xo, a), convergent to x9, f(x,) is con- 
vergent to A. We can similarly define at the point x = x, the limit 
from the left f(xy»—0) = B of f(x), defined in an interval (b, xp). 
For example, we have for the function y = E(x) (see § 2, sec. 1) 
and for the integral argument x = n: E(n—0) = n—1, E(n+0) = 72. 
When the argument x, = 0, the limits from the left and right of f(x) 
are written respectively as f(—0) and f(+0). For example, if f(x) = 
= sign x (see § 2, sec. 1), then f(—0) = —1, f(+0) = +1. 

A function f(x), defined at a point x = Xo, is continuous there 
from the right (left) if f(x9+0) [f(xp—90)] exists, equal to f(x). 


11. Continuous and discontinuous functions 


If 
f(%o— 9) = f(%o +0) = f(%); (1.12) 


the function f(x) is said to be continuous at the point x = Xp. If f(x) 
is not defined in the interval (6, x,) or (Xo, a), the left- (or right-) 
hand term in (1.12) is ignored. (See also p. 59). If f(x), defined on the 
set X, is continuous at every point x €_X, it is said to be continuous 
on the set X. 


For instance, f(x) = J(x) is continuous for all x = 0. 

Otherwise, /(x) 1s described as discontinuous. We say that (f(x) bas 
a discontinuity of the first kind or jump at the point x = Xp if f(x» —0) 
and f(x, +0) exist, but (1.12) is not satisfied. In all other cases of a 
discontinuous function, the point x = Xp is called a point of discont-- 
inuity of the second kind. For instance, the function 


—1 for |x|<1, 
x)= 
a e for |x|21 
has a discontinuity of the first kind at the points x, = —1 and 


Xo = + l. 

Certain commonly encountered functions y = f(x) are equal, 
at a point of discontinuity of the first kind x = Xp, to the arithmetic 
mean value 

Xo — 0) + f(x) +0 
(eyes 0 4K 0 ) 
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For example, in the case of f(x) = sign x (see § 2, sec. 1): 


We say that f(x) is uniformly continuous on the set X if, given any 
é > 0, there exists a 6 = d(e) > 0 such that, for any pair of points 
x’, x" € X for which f(x) has a meaning, | x’— x” | < dimplies | f(x’) — 
— f(x’)| < e. Afunction f(x), defined and continuous on a bounded 
segment [a, 5], is uniformly continuous on this segment (Cantor’s 
theorem). 


12. Functional sequences 


An important role is played in analysis by functional sequences 
{f,(x)} (1 = 1, 2,...), defined on some set X of the numerical 
axis E£,. Various definitions can be given of passage to the limit for 
such sequences. It is natural to start from passage to the limit at 
each point, when {/,(x)} becomes a numerical sequence for any 
fixed x € X. If the sequence {f,(x)} is convergent as n - oo for any 
x € X, its limit depends on the point x € X, i.e. is a function f(x) (a limit 
function), and this is written as 

TrlX) ——> f(x) or lim Sal) = f(x) xEX. 


EXAMPLE 21. _ 


for x<0O, 


; wu, 
lim arctannx = —signz = for x= 0, 


n—> +co 2 
for x>0. 


wl a o vla 


This example shows that the limit of continuous functions may be 
a discontinuous function. 

As a result of a double passage to the limit, functions can be 
obtained in the limit that have even more complicated discontinuities, 


for instance, 
lim lim (cos 272m! x)" = (x), 


Mm—> oo TN —> co 
where y(x) is Dirichlet’s function: 
x(x) = 


1 if x is rational 
O if «x 1s irrational. 
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REMARK. Together with functional sequences, we often encounter 
in analysis sequences of numbers, dependent on functions (functionals) 
For instance, the mean values of functions are defined by the limits 
of such sequences. 

If the function f(x) is integrable on [a, 5] and f,, = f(a+76,), 


b= 
6, = oo then 


l-> co Nope 


1 fe 
lim > 3 fan = pg | SOD 
is the arithmetic mean of f(x) on [a, 5]; 


a Nien: -Snn = Xp {A mi f(x) ax 


is the geometric mean of f(x) on fa, 5), and 


nm 1{\72 6 dx \71 
linn ( ¥ 7) =~ [ 5) 


is the harmonic mean of f(x) on [a, 5]. 

The following also holds: 

THEOREM 4. If functions f(x) and g(x) are continuous and positive 
on f[a, 6], then 


(1) lim Vf g(x) [ f(x)!" dx = Bia Se), 


[ 2(x) font? de 
(2) lim “}———————— = _ max f(x). 
[a Lfeyrae 29 


13. Uniform convergence of functions 


The concept of a uniformly convergent sequence of functions {f,(x)} 
plays an exceptionally important role in analysis. 

DEFINITION. A sequence of functions {f,(x)}, defined on a set 
X c £,, is said to converge uniformly as n — o to the function f(x), 
also defined on the set X, if, given any positive number &, an integer 
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N = Ne) can be found, independent of x € X, such that, for alln > N: 
IFn(x) —f(x) | < &. (1.13) 


If {f,(x)} is convergent as 7 + oo at every point x€ X, but does 
not satisfy the uniformity condition (1.13), we say that {/,(x)} 
converges non-uniformly to f(x) on the set X. With non-uniform 
convergence, the number N depends not only on the choice of «, 
but also on the number x € X: 

N = Ne, x). 

THEOREM 5. Jf all the functions f,(x) of a sequence {f,(x)}, uni- 
formly convergent to f(x) on X as n—~ © are continuous, the limit 
function f(x) is also continuous on X. 

It follows from this that, if the limit function is discontinuous, 
the convergence as n + © of the sequence {f,(x)}. is non-uniform. 

EXAMPLE 22. The sequence {f,(x)} = {x"} is uniformly convergent 
asm—+ oo to f(x) = 0 on any segment [0, g], 0 < g < 1; on the 
segment [0, 1] this sequence converges non-uniformly to the function 


0 for Osx<1, 
fe) =} 5 for = 1. 


Fic. 1. 


Caucuy’s Test. A necessary and sufficient condition for a sequence 
of functions f,(x), defined on a set X C E,, to be uniformly convergent 
asn —- toa function f(x) is that, givenanye > 0, there exists an N, 
depending only on e, such that |f,(x)-f,,(x)| < € for all x € X, 
provided only that n > N and m > N. 
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Geometrical interpretation of uniform convergence. Let f(x) (n= 
= 1,2,...) be continuous in [a, b], and let the sequence {/f,(x)} be 
uniformly convergent as” ~ oo to the function f(x), continuous in 
[a, b]. Now, all the curves y = f(x) fall within an e-neighbourhood 
of the curve y = f(x) when n > N (see Fig. 1), i.e. they are contained 
in the strip between the curves y = f(x)—e and y = f(x)+ 6. 


14. Convergence in the mean 


A functional sequence {f,(x)} is convergent in the mean on the 
segment [a,b] c E, as n+ o to the function f(x) if, given any 
€ > 0, there is a number N such that, for all n > N, we have 


| "U@-ioharss 


(it is assumed that this integral exists). 
Use is often made of convergence in the mean in various branches 
of analysis (for instance, in the approximation methods of analysis). 
Convergence, defined by the norm of a space (see Chapter II, §1, 
sec, 2), is a generalization of convergence in the mean. 


15. The symbols o(x) and O(x) 


Given two functions x(t) and y(t), defined on a set X, if their ratio 
x(t)/y(t) tends to zero ast +~ a € X (lim x(t)/y(t) = 0), we say that 


t—-a 


x(t) [y(t)] is an infinitesimal (infinitely large quantity) with respect to 
y(t) [x(t)] and we write symbolically: 


x(t) = o((¢)). 


For example, t? = o(sint) as t +0, t" = o(e') as t + @ for 
any n > 0. 

If x(t) and y(t) are infinitesimals as ¢ ~ a, and x(t) = o(y(t)), 
we say that x(t) ((t)) is an infinitesimal of higher (lower) order 
with respect to y(t) (x(t)), or: x(t) (y(t)) decreases faster (more slowly) 
than y(t) (x(t)). 

If x(t), y(t) are infinitely large quantities as tf + a, and x(t)= o(j(1)), 
we say that x(t) (y(t)) increases more slowly (faster) than y (t) (x(t)). 
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If | x(t)| = Cl y(t)| (C.is a positive constant), we say that x(t) does 
not decrease at a faster rate than y(t) or that x(t) does not increase 
at a faster rate than y(t), and we write symbolically: 


x(t) = O((2)). 
For instance, ¢t = O(tsin(1/t)) and t = O(tan 2f) as t > 0, 


I 
= oles ‘ and et = O(eM+1) as t+ a. 
In particular, if lim x(t)/y(t) = C ¥ 0 (C Is a constant), then 
t—>a 


x(t) = O(n()) and y(t) = O(x(A). 


THEOREM 6. Whatever the sequence of functions f,(x), defined in 
‘the neighbourhood of a point x = a, there always exists a function 
g(x) € M, decreasing (increasing) faster then any of the f,(x) asx — a. 


16. Monotonic functions 


A function f(x) is described as monotonically non-increasing (non- 
decreasing) on a set X (e.g. on [a, 5)), if, given any points x,, x, € X 
such that x, < X, we have f(x,) = f(x2) (f(*,) S f(%2)). A function 
f(x) is said to be monotonically increasing (decreasing) in the strict 
sense (or to be strictly monotonic) if f(x,) < f(x2) (f(x) > S(x2)) 
for any x,, X», € X for which x, < Xp. 

Functions monotonically non-increasing, monotonically non- 
decreasing, and strictly monotonic are all described as monotonic. 

When f(x) is monotonic, it always has limits from the left and 
right at a point of discontinuity x = x,; if f(x) is non-increasing, we 
have 


I (Xo — 9) = f(%o) = f(X0 +9); 


if f(x) is non-decreasing, 


F(xo— 9) S f(%o) S f(%o+ 9). 


Let y = f(x) be a monotonically increasing (decreasing) continuous 
function, defined in a segment interval or semi-interval XY € E,, and 
mapping X into a segment, interval or semi-interval YCE;; 
an inverse x = o(y) of f(x) now exists, defined on Y. The function 
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g(y) is continuous on Y and is monotonically increasing or decreasing 
along with f(x). For example, the function y = x? in the semi-interval 


(0, + co) has an inverse x = Jy in (0, +o). 


17. Convex functions 


A function f(x), defined on a set X (a finite or infinite interval, 
semi-interval, segment) is described as convex if, given any numbers 
X1, X_ € X, we have 


l 
(8) = pe) fea 
f(x) is described as concave if the reverse inequality is satisfied: 
xX,—-X. l 
(2*) = 5/1) —foh 


This means geometrically that, if f(x) is convex, no arc of the curve 
y = f(x) lies above the chord subtending it, whereas if f(x) is concave, 
no arc of the curve y = f(x) lies below the chord subtending it. 

For example, the functions | x|, x?, e*, x +|x| are convex, while the 
functions— | x], f x, —e7*are concave; thefunction y = x*(x > 0) 
is convex « = 1 and a < QO andconcave for 0 < « < 1. A necessary 
and sufficient condition for a function f(x) to be convex on [a, 5] is 
that, given any numbers x,, x2, x; satisfying a = x, < x, < x3 3), 
the following inequality holds: 


x, f(x) 1 
X_ f(%) 1/20. 
x3 f(x3) 1 


If f(x) is continuous (even only from the right) and f(x) = x [f(x- 
—h)+f(x+A)], it is convex. 


x 
If f(x) is monotonic in [a, 5], | f(&) d& is a convex function. 


a 
It must be borne in mind that the graph of a convex function faces 
downwards, i.e. it is a concave curve in the accepted geometrical 
terminology. 
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Convex functions have the following properties: 


1°. A convex (concave) function f(x) is continuous at every point 
of its domain of definition. 

2°. If f(x) is convex, —/(x) is concave on the set X. 

3°. A convex (concave) function f(x), not equal to a constant on 
the segment [a, 5], cannot attain a maximum (minium) inside [a, 5]. 

4°, If f(x) is convex (concave) on [a, 5], and /(x) is a linear function, 
where /(a) = f(a) and /(b) = f(b), then either f(x) < I(x) (f(x) < I(x)) 
at every point of (a, b), or f(x) = /(x). 

5°. A linear combination of convex functions with positive coeffi- 
cients is a convex function; in particular, the sum of a finite number 
of convex functions is a convex function. 

6°. If f(u) is a non-decreasing convex function, while u = 9(x 
is a convex function, f[g(x)] is a convex function of x. 

7°. The inverse of a decreasing (increasing) convex function is 
a convex (concave) function. 

8°, If f(x) is convex on [a, 5], given any positive numbers p;> 0 
(i= 1, 2,..., m) such that p,+p.+...+p, = 1 and any points x,, 
Xp, +++; X, On the segment [a, 5], we have 


S(DiX%ytDoXet «0. tPnXn) S PiS(%1) +Pof(%)+ -.. +PnS(Xn)- 


9°, Any convex function f(x), satisfying the condition f(x,) = 0, is 


expressible in the form 
z 


fa) = | rt) at 
Xo 
where p(t) is a non-decreasing function, continuous from the right. 
A function 9(x), defined on a set X C E,, is described as logarithm- 
ically convex if log p(x) is a convex function, i.e. if 


x,;—-x 
# (AS) = owoce 
for any xX;, xX, € X. Alogarithmically convex function is a convex func- 


tion. For instance, the function (x) = x log x is logarithmically 
convex for x >0; 9(x) = e*’ is logarithmically convex for all x€ 
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E(— 0, + 0); o(x) = x* (kis an integer) is logarithmically convex for 
x€(—oo, +o) and even k #0, for x€ (0, +) and any k <0; 
I(x) = r—le—! dt is logarithmically convex for x > 0 (concerning 


0 
the function J(x), see Chapter VI, § 4, sec. 5). 


CHAPTER Il 


n-DIMENSIONAL SPACES AND 
FUNCTIONS DEFINED THERE 


Introduction 


We considered in Chapter] functions ofa single variable as functions 
of a point of the numerical axis £,. Similarly, functions f(x, y) of two 
variables can be regarded as functions of a point of the plane £, with 
coordinates x, y, and functions f(x, y, z) of three variables as functions 
of a point of space E, with coordinates x, y, z. 

About the middle of the last century, coordinate space of n dimen- 
sions was introduced into mathematics, and functions of m variables 
came to be regarded as functions of a point of n-dimensional space. 
At the same time, various concepts of ordinary two- and three-dimen- 
sional geometry were generalized to n-dimensional spaces. 

This generalization proved to be not merely formal. Our geometrical 
intuition can be carried over to multi-dimensional] entities, and the 
treatment in geometrical terms of the problems of analysis and algebra 
of 7 dimensions led to greater clarity. Geometrical intuition sometimes 
enables us to discover the facts in n-dimensional geometry, which can 
be interpreted as corresponding facts of analysis and algebra. 

In the present chapter § 1 deals with the theory of n-dimensional 
spaces, and in particular with the theory of orthogonal systems of 
vectors, which is an elementary analogue of the more complicated 
theory of systems of orthogonal functions, discussed in Chapter IV. 

Section 2 is devoted to passage to the limit, continuous functions 
and continuous (in the generalized sense) operators on them in n- 
dimensional space. It is directly related to Chapter I, in which we 
discussed the same topics for the particular case n = 1. 

Section 3 gives a treatment of one of the branches of n-dimensional 
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geometry —- the theory of convex n-dimensional bodies, which, apart 
from its geometrical interest, has acquired importance in a number of 
applied mathematical problems. It should be remarked that no great 
simplification is obtained by confining the discussion of convex 
solids to three-dimensional rather than n-dimensional space; and in 
fact, it is precisely the theory of convex bodies in space of a large 
number of dimensions that has acquired practical applications. 


§ 1. n-dimensional spaces 


1. n-dimensional coordinate space 


An element X of an n-dimensional space E,, is defined as a set of 
n numbers x,, X2, ..., X,- It is written as X(x,, x2, ..., X,) or X = 
= (X,, Xg,..., X,). The space E,, is the set of such elements. 

Elements of the space E,, are treated in two ways: on the one hand, 
they are regarded as points with coordinates x,, Xz, ..., X,, on the 
other, as vectors with coordinates x,, X, ..., X,, (n-dimensional vector 
space), We shall start by using the first treatment. 

There are various ways of introducing distance or a metric into 
the space E, (see, for example below, § 3, sec. 3). The most com- 
mon is the following (Euclidean) metric: the distance o(X, Y) between 
the points X(X1, Xe, .. +» X,) and Y (yy, yo ..-, ¥,) Of E, is defined as 


the number 
AG Y= | ¥ Oi-y. (2.1) 
i=l 


The space £,, with a distance introduced in this way is called n-dimen- 
sional Euclidean space. 

Formula (2.1) reduces to the formula for the distance between two 
points in analytical geometry when n = 1, 2, 3. 

We write 0 for the point with zero coordinates: 0 = (0,0, ..., 0) 
(the origin of coordinates). We have 


o(X, 6) = J yx. (2.2) 


im] 
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The distance thus introduced has the following properties: 
(1) 0(X%, Y) 20, where o0(X, Y) = Oonly when X¥ = Y; 
(2) o(fX, Y) = of X, Y); 
(3) ofX, Y) S of X, Y)+0(Y, Z) 


(the triangle inequality). 
An attempt is generally made to preserve these properties in 
generalized concepts of distance. 


2. n-dimensional vector space 


The n-dimensional space E,, can also be regarded as a vector space. 
The operations of addition and multiplication by a scalar (number) 
can be performed on vectors in the plane £, and in three-dimensional 
space Ey. Every element X (x, Xo, ..., X,) of E,, will be regarded as a 
vector with coordinates X,, Xq, ...5 Xp: 

The sum of two vectors X (Xj, Xo, ..+, X,) and Y (},, Ye, ++» Vn) 
is the vector X+ Y of E,, with coordinates x+y, Xy+Jas - +s Xn tVn 
The difference X—Y is similarly defined. 

If A is a number (scalar), and X(x,, Xs, ..., X,) is a vector of £,, 
AX denotes the vector of E,, with coordinates Ax,, Axa, ..., Arp. 
Vectors X and AX are described as collinear. Linear operations on 
vectors reduce to linear operations on their coordinates. 

The zero point 6 corresponds to the zero vector @ with components 
equal to zero. Obviously, ¥+6 = X, Ad = 0. 

The vectors 


e,(1, 0, 0, ..., 0), e(0, 1, 0, ..., O), ..., e,(0, 0, ..., 0, 1) 
or alternatively, 
e;(d,), dio, oe eg bi55 eee, Oin)s 

where 6,, is the Kronecker delta: 

0 for is#/,, 

by = ag: 

1 for = j, 
are called unit vectors. The following equation holds for any vector 
XS (Xp ey sey H)° 


nr 
A= > Xe}. 


t=] 
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The norm || X|| of the vector X is the number 


WxXI = | Fx, (2.3) 
im] 


equal to the distance o(X, 9) from the point X to 8. 
The norm of a vector satisfies the conditions: 
(1) {|X][ 20, where {| X]| =0 only when X = 6; 
(2) AXI| = JALIL: (2.4) 
(3) [[|X+¥]] s [X41] YI. 
The distance 0(X, Y) between elements X and Y, introduced in 


accordance with (2.1), is the same as the norm of the difference be- 
tween the corresponding vectors 


o(X, Y) = ||X-YII.- (2.5) 
The sphere S(Xo, r) in E,, of radius r with centre at Xo is the set of 
points (vectors) X, for which 
Q(X, Xo) = |X—-Xll <7. 
If we introduce for sets in E, the notation introduced in Chapter I, 
§ 2, sec. 2, we have 
S(Xo, r) = (o(X, Xo) < r).t 


3. Scalar product 


In analogy with the two- and three-dimensional case, the scalar 
or inner product of two vectors X(X1, Xe.» +» X,) and Y(y4, Vos +s +» Yn) 
of E,, is defined by the equation 


nr 


XY = (XY) = ¥F xiy;. (2.6) 
i=} 
The elementary properties of scalar products are: 
(1) XY = YX; 
(2) XX = || X]|? = 0. 


CAUCHY’S INEQUALITY. Given any two vectors X(X1, X) «++» X,) and 
YO", Yor - ++» Yn) Of E,, we have 


[XY] = [XII V1 (2.7) 
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or 
n 


» Xiyi 


im] 


Ss 


(2.7) 


i=l = ims] 


Equality holds in formulae (2.7) and (2.7’) if and only if the vectors 
X and Y are collinear (i.e. if X = 6 orif Y = AX, Le. if all the x; = 0 
ory, = Ax; (i = 1,2,..., )). 

The angle between two vectors. Let X(x,, %, .-., X,) and Y¥(j,, 
Yo: + + +» Yn) be two vectors of E, different from 6; the angle p» between 
them is given by 


cos py = (2.8) 


xy 
Hy ll 
In view of (2.7), |cos g| = 1. 
The projection of the vector X on to the vector Y is given in magnitude 
by 


2 — |x|] cos Q. (2.9) 


lly] 


When |] Y {|= 1, the projection of vector Y on to Y is equal in magnitude 
to their scalar (inner) product: 


XY = [| X|| cos o. (2.10) 


EXAMPLE 1. The magnitude of the projection of the vector X(x,, 
Xo, . ++, X,) On tothe unit vector e;(i = 1, 2, ..., m) is equal to the 
coordinate x, of the vector YX. 


4. A linear system and its basis 


An n-dimensional vector space is a particular case of an n-dimen- 
sional linear system. 

A linear system L is a set of elements to which we can apply the 
operation of addition, i.e. the operation of finding a new element 
c€L from two elements a, b€ L, c = a+b, and the operation of 
multiplication by a real number 4, i.e. the operation of finding from 
an element a¢Z and a number A an element d = Aa€L. These 
operations have the following properties: 
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(1) (a+b)+e¢ = a+(b+0); 
(2) a+b = b+a; 

(3) A(Aya) = (AAja; 

(4) A(at+b) = Aat+Ab; 

(5) (A+A)a = data; 

(6) l.a=a. 


The system L possesses a zero element 6, for whicha+@ = a,0.a = 0 
for aé L. 

Linearly independent elements. Elements x, Xo, ..., X; Of a linear 
system are said to be linearly dependent if there exists a set of numbers 
Cy, Co, .. +, Cy, NOt all zero, such that 


CyXy Ht CoXy +... Cex, = O; (2.11) 
if there is no such set of numbers, i.e. if (2.11) is satisfied only with 
GQ=%=...=c¢, = 0, 


the elements x;, Xo, ..., X; are said to be linearly independent. 
EXAMPLE 2. On a plane, the vectors X; (1, 1) and X, (2, 3) are line- 

arly independent, while the vectors X,(1,1) and_X; (3, 3) are linearly 

dependent (since 3X,—X3; = 8). In three-dimensional space, the 

vectors Y, (1, 0, 0), Yo (1, 1, 0) and Y, (1, 1, 1) are linearly independent; 

the vectors Z, (1, 0, 0), Z, (2, 1, 1) and Z, (3, 2, 2) are linearly dependent 

since 

Z,—2Z,+2Z, = 0 


A linear system is described as n-dimensional if it contains m line- 
arly independent vectors, and any +1 elements of it are linearly 
dependent. A linear system is said to be infinite-dimensional if it con- 
tains any number of linearly independent elements. An n-dimensional 
vector space is an m-dimensional linear system. 

The set of solutions of a linear homogeneous differential equation 
forms a linear system. In the case of an ordinary nth-order equation 
this system is n-dimensional; in the case of a partial differential equa- 
tion the system is infinite-dimensional. 

The basis of an n-dimensional linear system L,, is any set (e, @2, . . «; 
e,) of n linearly independent elements. 
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Any element | of the system L,, is linearly (and uniquely) expressible 
in terms of the elements of the basis: 


] = Xy0y + X.lot . 2. +Xnepn; (2.12) 


the elements x,e, (i = 1, 2,..., m) are called the components with re- 
spect to the basis (e;, é:,..., €,) while the numbers x, are the coordi- 
nates with respect to this basis. 

EXAMPLE 3. The unit vectors e; form a basis in n-dimensional vector 
space: 


e, = (1, 0, 0, ..., 0), e, = (0, 1, 0, 2545 0), sax 
sept = 0,0) 24g Oy 1): 


An m-dimensional linear system can be regarded as an n-dimensional 
Space, in which the elements of the basis play the part of unit vectors. 


Examples of n-dimensional linear systems. Linear systems of functions, for 
which addition and multiplication by a number are understood in the ordinary 
sense, are aften encountered in analysis. We shall quote some examples. 

(1) The (#+1)-dimensional system of polynomials 


P(x) = ce, 
ke 0 
of degree not higher than a. The system of powers 
Xi kt eda es 
can be taken as the basis, as also can any system of polynomials 


Po = 1, P,(x) = X+2A109; 


k-1 
P(x) = x*+4g:X+Gqq, --+, Py(x) = x*+ »y Ox 6h 
alas n-1 
vee Pax) = x8 + Yo ayer’ 
im 


(2) The system of homogeneous polynomials P, (x,, X2, ..., X,) of degree 
k in n variables x,, X2,...,X,, i.e. sums of terms of the form 


Gi ks wee rer ae xi, 
where 


k,+k.+ eee +k, = k. 
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The basis of this system consists of all single terms of the form xhaxte ee x*n 
of degree k = k,+k,+ ... +k,. The number of such single terms (i.e. the number 
of dimensions of the system) is 

(n+k—1)! 


For instance, with 2 = 3, k = 3, the number of them is equal to 5!/3!2! = 10 
(the single terms are Xx}, x{X2, X[Xgy XiXgo XyXoXg, XX}, X2, XZXq, XQX3, x3). 


If a system L,, has one basis (e,, @), ..., €,), it has an infinite set 
of bases. Let (e;, Cox: rer e,) be another basis; then the elements 
e, of the old basis are expressible in terms of the elements e; of the 
new in accordance with 


n 
Qo= yy X52; {i eee? eens <3 
j=l 


where the determinant |~,;|j:;* # 0. An element /is expressible in 
terms of the elements of the new basis in accordance with 


n 
l=) xe. 
i=} 
The connection between the coordinates x, and x; of an element / 
with respect to bases (e,) and (e;) is given by 
Tr 
x; = yy 55 X3 (i = l, 2. oeey n). (2.13) 
j=l 
It follows from what has been said that the elements of any n-dimen- 
sional linear system L, with basis (e,, e, ..., €,) can be regarded as 
vectors of an n-dimensional space in which the elements e, of the 


basis play the role of unit vectors. We shall confine our attention 
to such spaces in the present chapter. 


5. Linear functions 


A linear function or linear form in E, is a function f(X) = f(x, x,...; 
x,), Satisfying the conditions: 


1) AX+Y) = f(X)-f™). (2.14) 
(2) f(AX) = Af(X), where A is any number. (2.15) 
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If f(e;) = y; for the unit vectors e; (i = 1, 2, ..., m), then 


nr n 
f(X) = S(%, Xyy ees Xn) s( 3 sti) =e »y Viri- (2.16) 
t=} t=] 
The numbers y, are the coefficients of the linear form f. 
These coefficients can be regarded as the coordinates of the vector 
Y = (yy, Yor --+> Yn) Of E,3 we now have from (2.16): 


f(X) = YY. (2.17) 


The linear function f(X) is equal to the scalar product of the fixed 
vextor Y with the variable vector X. We usually say that the function 
S(X) is generated by the vector Y. 

The scalar product XY is a bilinear function of X and Y: it is a 
linear function of X if Y is fixed, and a linear function of Y if X 1s 
fixed. 

We have the equation 


| ¥|] = max YX. (2.18) 


i.e. the norm of the vector Y generating the linear form YX is equal 
to its maximum value on the unit sphere || X|| = 1. 
Criteria for linear independence. The Gram determinant for vectors. 


Let 
Xi(Xiy, Xi2> erey Xin) (i = I, 2: ee ey n) 


be vectors of the space E,. From them we form the following 
determinant: 


A(X,, Xop .2-, Xp) = OB MR An (2.19) 


THEOREM 1. A necessary and sufficient condition for vectors X, 
Xo, ---» Xz, Of E,, to be linearly independent is that 
A(X, Xo, se<5 Xy) = 0. 


Gram’s determinant I'y, x, ..., x, of the vectors X;, X, ..., Xp 
of £, is given by 
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(XX) (XX) «.. (MX) 
(X,X1)  (X_X) «.- (2% mn) 


(XmX1) (XmX2) «+» (Am*Xm) 


P’x,x2... Xm = (2.20) 


Gram’s determinant has the properties: 
(1) Lyx, ... x, = 9% 
(2) A necessary and sufficient condition for linear independence 
of the vectors X,, Xq, ..., X,, 1s that 
D'x,x_... Xm > 03 (2.21) 
(3) When m= a, 


I’x.x; eae ge oo [4(%, Xo, cosy XJ): 


See Chapter IV, § 2, sec. 3 for the Gram determinant for functions. 

Manifolds. Let X,, Xz, ..., X, be linearly independent elements 
of E,(lsk <n). 

A set of elements X of the form 


k 
X= ¥ ax; (2.22) 
isl 
with arbitrary real c; is called a k-dimensional linear manifold. 

A one-dimensional linear manifold, i.e. a set of elements of the 
form X = Ax, (x, # 9) is a straight line passing through 6 and x,. 
Part of this straight line — the set of elements of the form X¥ = Ax,, 
A> 0, — is called a ray. 

A displaced k-dimensional manifold or k-dimensional plane is a 
set of elements X of the form 


h 
X= Xt ¥ eX; (2.23) 
i= 
with fixed and linearly independent %,, X2, .... X, and arbitrary 
values of the numbers c,, cg, ..., ¢,. It is obtained by displacement 
of the manifold (2.22) along the vector X,. A one-dimensional! displaced 
manifold is a straight line: 
X = Xot+tx, (—-02< f< +o), (2.24) 
We have for a straight line through the points YX, and X,: 
X= (1—-1)X, +X, (— 0 <f< + ov), (2.25) 
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The segment of the straight line joining points X, and X, is the set 
of elements of the form 


X=(1-0%,41%, (0s181). (2.26) 


An (—1)-dimensional displaced manifold is called a hyperplane. 
Any hyperplane is given by an equation (i.e. is a set of points X(x;, 


Xy, ...+) X,), Satisfying the equation) 
nh 
YX = » JjXjU = d, (2.27) 
j=l 


where YX is a linear form generated by the non-zero vector Y (), ye, 
++) Vn). Conversely, every such equation defines a hyperplane. 

In general, any k-dimensional linearly displaced manifold (\ = k < n) 
is given by a system of equations 


nN 
Y,X = »y Jijxji = d; (i = l, 2; ee ey n—k), (2.28) 
j=l 


where the vectors Y; ( 4, Vio» -- +» Yin) (F = 1, 2, ...,"—k), generating 
corresponding linear forms, are linearly independent ; in other words, 
every such manifold is given by n—k linear equations. Conversely, 
n—k equations (2.28) (with linear independence of the vectors Y,) 
define a displaced k-dimensional manifold. If all the right-hand 
sides d, = 0, we get a k-dimensional (non-displaced) manifold. 
In particular, the straight line (2.24) is given by n—1 equations (2.28). 


6. Linear envelope 


The linear envelope of a set M of E,, is the least linear manifold 
containing M: in other words, the linear envelope of the set M is 
the set of all linear combinations of any finite number of elements 
of M, 1.e. of elements of the form 


a 
> uX;, X,€ M. 
ix} 


In particular, if X,, Xo, ..., X; are linearly independent elements of 
E,,, their linear envelope is the k-dimensional linear manifold con- 
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sisting of all elements of the form 


k 
i=1 

Notice that, if the vectors X,, X2, ..., X; form a basis of the 
k-dimensional linear manifold E, of £,, we can supplement them by 
vectors Z;, Zy, ..., Z,—, in such a way that the vectors X,, X_ ...5 Xp; 
Z1 Zyy --+» LZn_z form a basis in E,. Let E,_, denote the linear 
envelope of vectors L,;. Everyelement Y of E,, can be expressed (unique- 

ly) as 
Y= X+Z, (2.29) 

where 


R n—-k 
x= Y ciX; € Ep, L= ys d;Z; € En_p- 
i=l j=l 


Here, the space £,, is the direct sum of the manifolds £, and E,_,, 
this being written symbolically as 


E, = Ext+Enon (2.30) 


X and Z in (2.29) are called the components of the vector Y in E, 
and £,_,. 


7. Orthogonal systems of vectors 


Two (non-zero) vectors X and Y are said to be orthogonal if XY = 0 
(i.e. if cos g = 0). The vectors X,, X,, ..., X,, form an orthogonal 
system if they are orthogonal in pairs, i.e. 


X;X;=0 for i#j. (2.31) 


The vectors of an orthogonal system are linearly independent. If, in 
addition, || X;|| = 1, the vectors are said to form an orthonormal 


system. In this case, 
0 for ij 
LX bee ee (2.32) 
1 for i=/j. 
The unit vectors e,, é., ..., &, form an orthonormal system. 
In n-dimensional space E,, there exists an infinite set of orthogonal, 
and in particular orthonormal, systems of m elements, but there are 
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no orthogonal systems of (+1) elements. A system of m orthogonal 
vectors in E,, forms a basis in E,, called an orthogonal basis. 

THEOREM 2. If vectors e,, €,, ...,€,form an orthonormal system in 
E., any vector X of E,, is expressible (uniquely) in the form 


n 
X=) xe, x, = Xe;, (2.33) 
t=] 
nr 
|X|? = >) x;?. (2.34) 
ia] 


The passage from unit vectors e, é, ..., e, in E, to another 
orthonormal basis ¢}, €,, ..., ¢, in E, is called an orthogonal trans- 
formation. An inner product of vectors is unchanged in an orthogonal 
transformation, i.e. if 


k n 
X= FP xq = Yo xe, Y= Soe = ¥ yeh 


iw] t=] i=] im] 


then 


nr 
XY = » xii = y XY} 
Qn] t=1 

In particular, the norms || X|| = JXX (see (2.34)) of all elements 
of £,, and the distance between any pair of such elements: o(X, Y) = 
=: || X—Y||, are unchanged by an orthogonal transformation. 

In general, if vectors e}, e,, ..., ¢, form an orthogonal system, 
we have 


nn , 

X=) xiej, x,= cic a (2.33') 
i=l I} e; | 

|X ||? = py x}? |fef ||? = ry (Xe;)?. (2.34') 


In analogy with the theory of orthogonal series (see Chapter IV), 
the coefficients x; in equations (2.33) and (2.33’) can be termed 
Fourier coefficients. 
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8. Biorthogonal systems of vectors 


Two vector systems X;, Xo, ..., X, and ¥;, Yo, ..., Y, of E, 
form a biorthogonal system if 


XY; = 0 for lx ds Xi Y; #0 for i= j. (2.35) 
Multiplying the vectors ¥, or Y, by constants, we can arrange that 
X,Y; = 1 (ele 255.5) 


where the old notation is retained for the new vectors. In this case, 
every vector Z of E,, can be written as 


n 
Z=>) Xn % = ZX, (2.36) 
iml 
or as 
nr 
Z= X VX Ye = ZY; (2.36’) 
== 


Given a system of n independent vectors X,, Xz, ..., X;, in E,, we 
can form a system of vectors Y,, Yo, ..., Yn, such that the two systems 
{X;} and {Y,} are biorthogonal. If 


Xi = (Xie Xian sees Min) and Yj = (in, Vior ~~ + Vin); 


formation of the system {Y,;} from the system {X,} amounts to 
formation of the inverse || y,;||}-j' of the matrix ||x,;||}j. (See 
Chapter IV regarding orthogonat and biorthogonal systems of 


functions). 


i 
EXAMPLE 4, Let X¥,; = )) e (i= 1, 2,..., m), where e; are unit 
j=1 
vectors in £,; Y; = e;—e;4, G@ = 1, 2, ..., n—1), Y, = e,. In this 
case {X,} and {Y;,} are biorthogonal systems in E,,. 


9. The projection of a vector on to a manifold 


Let E, be a k-dimensional manifold in n-dimensional space E,, 
(1 = k < n). The vector X of E,, is said to be orthogonal to E,, (written 
as X | E,) if X is orthogonal to any vector Y of £,, i.e. 


AY=0: af... Y 1£e. 
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A vector X, of E, is called the projection of the vector X on to E, 
if X¥— Xj, is orthogonal to E,, 


Xo = Pl-z, X. (2.37) 
We have: 
X= Xot(X—X), (X—Xo) L En, Xo € E;. 
when X¢€E,, to pi.g, X = X. 


If XCE,, pip, X= X. 
Any vector X of E, has a unique projection on to £,. 
If X, is the projection of the vector X on to E,, we have 


(1) WXIP = Xl +i X— Xo ll, (2.38) 
(2) [|X—Y |? = ||X—-Xoll*, (2.39) 


where Y is any vector of E,, and equality holds only when Y = Xp. 
In other words, the minimum of || X—Y||?, where Y is any vector 
of E,, is attained when 


Y = Xo — pl.F, a. 


Let U, # @ bea vector of E,. We shall write £, for the set of vectors 
of the form tU, (- ox t=<+ ), te. the straight line £, = tU,. 
The projection of the vector X on to the vector U, is defined as the 
projection of XY on to the straight line £), i.e. we have: 


(2.40) 


and in particular, if || U,|| = 1, then 
Ply X = (XU.)Uy = (|X| cos g)Up, 


where q¢ is the angle between the vectors X¥ and U,. 

Expansion (2.33) of a vector X into a system of orthogonal vectors 
es = ], 2, ..., m) implies the representation of X as the sum of 
its projections on to the e,. 

Let X,, Xo, ..., X, be orthonormal! vectors in E,, (k < n); they 
form an orthogonal basis in E, — their linear envelope. We can 
supplement them by the vectors X,,; GG@= 1, 2, ..., m—k) such 
that the m vectors X, (i= 1, 2, ..., ™) form an orthogonal basis 
in E,. 
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Let X be any vector in £,; then 
h 
Pr.p, yo y C:X4, Cy = XXj. 
i=1 


The sum of the first k terms in expansion (2.33) or (2.33’) is the 
projection of the vector X on to the linear envelope of the first k vectors 
Ko ey Zech) 

Let the vectors {X,} (i= 1, 2, ..., k< n) be orthogonal. Let 


n R 2 
us form all possible sums )° c,e;. The expression || X¥— ¥° c,e, || attains 
i=1 ix 


a minimum when c, = x;, where c, is the “Fourier coefficient”; 

c, = XX; for || X,|] = 1, while in the general case c, = XX,/|| X; ||, 
THEOREM 3. Let {L,;} (i= 1, 2, ..., k) form a basis (generally 

speaking, not orthogonal in E,), and X be any vector of E_,; then 


k 
pre, X = dX d;L;, (2.41) 
J]= 
where d; are given by the system of linear equations 
h 
»~ (LL)dé;= XL,- (= 1,2,..., 4, (2.42) 
j=1 


the determinant of which is the same as the Gram determinant I’. 
When k =n, the system (2.42) becomes a system for determining 
the components of the vector X with respect to the basis {L,;} (i = 1, 
Lyin vy Dd): 


§ 2. Passage to the limit, continuous functions and operators 


1. Passage to the limit in n-dimensional space 


Let L,, be a linear system with a chosen basis. Every element X € L,, 
is defined by its coordinates x,, Xp, ..., Xn, X = (Xj, Xo) ..+5 Xp) 
Let {X,} = {%, X2, ...} be a sequence of elements of L,, where 
Xm = (Xmy Xmas +++» Xmn)- The element X = (x, X:, ..., X,) of L, 
is said to be the limit of the sequence {X,,} if 

xi = lim xp; (2.43) 


M—> co 
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(i.e. if all the coordinates of X are the limits of the corresponding 
coordinates of the terms of the sequence {X,,,}). We write convention- 


ally in this case 
X= lim X,:; (2.44) 


Mm —> oo 
and also speak of the sequence {X,,} converging to X. 

The coordinates of the elements {X,,} and X depend on the choice 
of basis in L,, but equation (2.43), 1.e. (2.44) also, does not depend 
on the choice of basis in L,: if the coordinates of X,, tend to the 
corresponding coordinates of X in one basis asm — oo, this property 
will hold for any choice of basis. 

An n-dimensional linear system, in which passage to the limit is de- 
fined in the sense indicated, is called an n-dimensional linear space. 

In Euclidean, and more generally, in normed (see § 3, sec. 3) spaces, 
where the distance between two points, or the norm of a vector, 
is defined, passage to the limit (2.44) can be defined as follows: 
X= lm X, if 

M—> co 
lim o(X,,, X) = lim ||X,—X|| = 0. (2.45) 
M—> oo M—> co 

Condition (2.45) is equivalent to condition (2.43). Thus, if we define 
the distance between two points or the norm of a vector (§ 1, sec. 1 
or 7) in a linear space, and make use of the definition of limit in 
accordance with (2.45), no changes whatever are introduced into 
the meaning of passage to the limit in L,.T 

There will be no loss of generality if we consider in this chapter 
passage to the limit in Euclidean spaces E,,. 

As in the one-dimensional case (see Chapter I, § 3, sec. 2), we 
shall call a sequence {X,,} of E, fundamental if, given any e>0, 
here exists NV such that 

|| Xm — m || < é, 
for all m’> N, m> N. 

A necessary and sufficient condition for a sequence {X,,} to have 
a limit is that it be fundamental. 

The concept of limit point (point of condensation) for a set M < E, 
iS an immediate generalization of this concept for E, : X is called a 


+ This introduction of a distance is called metrization of Ly. 
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limit point of the set M c E, if it is the limit of some sequence {X,,,} 
of points of M different from X. 

An equivalent definition is: X is called a Jimit point of the set 
M ifany sphere S(X, ¢) with centre at X contains a point of M 
different from X. 

An analogue of the Bolzano—Weierstrass Theorem holds (see Chap- 
ter I, § 3, sec. 1). 

Every bounded infinite set in E,, has at least one limit point. 

An open set in E, 1s a set U of points of E, such that, if a point 
X belongs to U, there exists a sphere with centre at X contained in 
U. An open set is called a domain if any two points of it can be joined 
by a step-line, contained wholly in this set. 

Examples of a domain are as follows: on a straight line, a finite 
or infinite interval; on a plane, the interior of a circle, triangle, strip 
between two parallel straight lines, etc.; in three-dimensional space, 
the interior of a sphere, parallelepiped, cone, etc. 

An example of a domain in E,, is a parallelepiped (a parallelepiped 
in £, is an interval), i.e. a set of points X(x;, x2, ..., X,), the coordinates 
of which satisfy the inequalities a,~< x,;~< 6b; (i= 1, 2, ..., n), 
where a, and 5; are given numbers. 

The intersection of any finite number of domains is a domain. 

A boundary point of a domain Q in E,, is a limit point of Q that 
does not belongto Q. The set of boundary points of Q is called tke 
boundary of Q. A domain Q together with its boundary forms a 
closed domain (or body) in E,. 

For example, the boundary of an interval (a, b) consists of the 
points a and 5, while the segment {[a, b] is a closed domain; the 
boundary of a sphere S(X), r) is the surface of the sphere, i.e. the 
set of points Y for which 


nr 
A(X, Xo) =] ¥ ox)? =v. 
i=] 


A closed set in E,, is a set in E,, containing all its limit points; for 
instance, closed domains are closed sets. 

THEOREM 4. The complement in E., of an open set (domain) is a 
closed set, and of a closed set an open set. 
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For example, the complement of the sphere (|| X]|| <r) is the 
closed set (|| X || = r), the complement of the closed sphere (|| X || = r) 
is the domain (|| X || > r). 


2. Series of vectors 


The laws for passage to the limits of vectors (points) of m-dimensional 
space E,, are essentially the same as the laws of passage to the limit 
in £,; the generalization to the n-dimensional case of the theory of 
conditionally convergent series (i.e. series which are themselves 
convergent, while the series formed from the absolute values of their 
terms are divergent) is of some importance. 

A vectot series in E,: 


» N= Aye (2.46) 
a 
is defined like a numerical series. 


If X, = (Xp Xpov - ++» Xkn)> SeVies (2.46) corresponds to the k 
numerical series 


2 Xpi = Ay tra tAgit .-- (i = 1, 2,..., n), (2.47) 
=1 


the terms of which are the coordinates of vectors X;,, i.e. of the terms 
of series (2.46). 
The partial sum S,, of series (2.46) is the sum of its first m terms: 


m 
Sm = 2 Xp — X,+Xet+ eee + Xin 
=} 


Series (2.46) is said to be convergent if its partialsums S,, are con- 
vergent aS m — oo to some vector S, the sum of (2.46): 


S=) X,= lim S,. 


kw} Mm —> co 


The convergence of series (2.46) is equivalent to the convergence 
of all the numerical series (2.47). If S = (s,, 5, ..., S,), then 


ss = >) Xp (i= 1, 2, 3, ..., 7). 
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Series (2.46) is described as absolutely convergent if the series of 
the norms of its terms is convergent: 


» WN Xell. 
k=l 

The absolute convergence of series (2.46) is equivalent to the 
absolute convergence of the numerical series (2.47). 

Series (2.46) is said to be conditionally convergent if it is convergent 
non-absolutely. We have Steinitz’s Theorem, which ts a generalization 
of Riemann’s Theorem (see Chapter III, § 1, sec. 2). 

(1) If series (2.46) is absolutely convergent, its sum remains unaltered 
whenever the order of the terms is changed. 

(2) If series (2.46) is conditionally convergent, its sum can be altered 
or it can be made divergent by changing the order of the terms. 

(3) The sums of the series obtained by interchanging the terms of 
aconvergent series (2.46) entirely fill some k-dimensional plane, 0S 
= k = n (see § 1, sec. 5). 

For an absolutely convergent series, k = 0; for a conditionally 
convergent series, k > 0. 

EXAMPLE 5. Let x, = (—1)*(1/k), and let s be an integer, 1 = s =n. 
Every positive integer m can be written in the form m= rs+k, 
where r is an integer, 1 Sk = 5. Let X,, = X,,4, = ¥;€,, where 
e, (k = 1, 2, ..., 5) are unit vectors. 

By changing the order in the series y X» We can now obtain as 


m 
the sum, any vector of an s-dimensional manifold E,— the linear 
envelope of the unit vectors e,, e,, ..., &, (see § 1, sec. 6). 


3. Continuous functions of n variabies 


Functions of a point (vector) of n-dimensional space. Functions 
of m variables may naturally be treated as functions of a point (or 
vector) of n-dimensional space. Let each point X (x,, x2, ..., X,) 
of a set M in n-dimensional space £,, be associated with a number 
ST (X) = f(xy, Xp, ..., %,)3 We mow say that a function f(X) =f, 
Xa. +) X,) of a point (vector) X or a function of n variables — the coor- 
dinates of this point (vector) — is defined on the set M in E,. 
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The concept of passage to the limit is introduced for functions 
in E,, as for functions of one variable. 

Let f(X) be a function defined on a set M CE, and let A be a limit 
point of M. We say that {(X) tends to a number a when X € M 
tends to A, if 


lim f(X,) =a. (2.48) 


for any sequence {X,,} of M, convergent to A. 
This 1s written as 


a= lim f(X). (2.49) 
XK —> A(X € M) 


(if M is a domain and A an interior point, it has to be mentioned 
that X,, tends to A while remaining in M.) 

There is another definition of such a limit, equivalent to the above: 
(2.49) means that, given any e> 0, there is a corresponding > 0 
such that, when 


O0< ||X¥—A||<7 and X¢€M 
we have 
If(X)-al<e. (2.50) 


Continuous functions. We take a function f(X) = f(x), Xo, ..-, X,) 
defined on a set Mc E,, and a point X (x), X2, ..-, X») Of this set. 
We say that f(X) is continuous at the point X € Mif 

lim f(%m) = f(X). (2.51) 
m€M 


Mm > oo, An 


This definition is equivalent to the following: a function f(X) 1s 
continuous at a point X of a set M if, given any e> O, there exists 


7 = 2(€) such that, for all points XY € M lying in the sphere 
o(X, X) = ||X-X|| < 9, (2.52) 
we have 


| f{X)-AX)| < «. (2.52') 


A function that is continuous at every point of a set M is said to 
be continuous in M. 
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EXAMPLE 6. The function 
1 1 


rene a0) = ee a 
vI- 1X1 1-¥ x 
ist 
is defined and continuous at every point of the sphere || X||? < 1. 
A linear function /(X) (see § 1, sec. 5) can be defined as a function 
continuous in E,, and satisfying the additive condition: 


AK +%) = f(X%)+f%). 


Uniform continuity. A function f(X) = f(x, x2, ..., X,), defined 
onaset Mc E,, is uniformly continuous there if, given any « > 0, 
there exists 7 > 0 such that, for any pair of points X,, X,¢ M for 
which 

o(X4, X_) = || X1— X2!l < 9, (2.53) 


| (XD) —f(%) | < €. (2.53) 


The number 7 in (2.52) depends on e and on the choice of the point 
X, whereas in (2.53), defining the uniform continuity of a function, 
it depends only on e and not on the choice of the points X, 
and Xo. 

Every function, uniformly continuous on M, is continuous on M. 
The converse is not generally true (for example, the function 
1/ w= || X|{*, continuous inside the sphere ||X|| < 1, is uniformly 
continuous there). 

As in the one-dimensional case (see Chapter I, § 3, sec. 11), we 
have 

THEOREM 5. A function f(X) = f(x1, X_, ..., X,), continuous on a 
bounded closed set U, is uniformly continuous there. 

Maximum and minimum. A function f(X), defined on a set M, is 
said to be bounded from above (below) on M if there exists a constant 
C such that, for any point XY € M, 


AMsc Y(M=O). (2.54) 


A function is bounded in & if it is bounded from above and below 
on M. 


we have 
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If f(x) is bounded from above (below) on M, a number C(c) exists 
which is the strict upper (lower) bound of the numbers /(X), i.e. of 
the values of the function f(X) at the points M: 


= sup f(x) (¢ = inf f(x )) : (2.55) 
XEM X€M 
If there exists in M a point X, at which 
S(Xo) = C = sup f(X), 
X€M 
the upper bound C is called the maximum of f(X) on M: 
C = f(X_) = max f(X). (2.56) 
X€M 


Xo 1s called the maximum point for f(X) on M. 
Similarly, if there exists in M a point X, at which 


(Xp = ¢, 
c= inf f(x), 
AEM 


twhere 


the lower bound c is called the minimum of f(X) on M, while X, is 
the minimum point for f(X) on M: 


¢ = flX,) = min f(X). (2.57) 
AEM 


We say in this case that f(X) attains its maximum (minimum) on 
M at the point XY, (Xj). 

THEOREM 6. A function continuous on a closed bounded set attains 
its maximum and minimum in the set. 

Jump functions. We often encounter in problems of mathematical 
physics the following generalization of the concept of jump to a 
function of n variables. Let Q; be a domain in E,. We say that it 
is “inside” its boundary I’, while the domain Q, = £,—(Qi+T) is 
“outside” the boundary I’. We shall write A; and A, for the points 
of QO, and Q, respectively.f Let a function f (which may or may not 


t i and e are the first letters of “interior” and “‘exterior”’. 
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be defined on I’) be given in Q;+Q,. Suppose that the limit of f(A,) 
[f(A,)] exists, when A, (A,) tends to the point A of the boundary I’; 
we shall write here: 


f(A) = lim f(A,). 
If f(A) # f(A), we say that the function has a jump 


fA) —f,{A) 


on passing through the boundary J" at the point A from Q; to Q.. 

EXAMPLE 7. Let us take a bounded closed convex domain Q, in 
E, with a boundary J” (a smooth curve), and the domain Q, = F,— 
—Q,—I’. Given an arbitrary point AéE,, we define a number 
a(A) > 0, measuring the angle under which the curve J’ is seen from A. 
(It is formed by the rays joining A to all the points of I’). 

For points A; €Q;, we have «(4;) = 2x; for points A, € Q,, we 
have 0 < a(A,) < 2, where a(A,) ~ z if A, tends to a point 4 ¢€ I. 
We have a(A) = 2 for points A of the boundary I’. 

For the function f(A) = @(A) at the point A € I’, we have f,(A) = 
=f(A) = « f(A) = 27; the jump f,(4)—f,(A) = —2. 

Functions depending on a parameter. Every function (x, Xa, .. .sXm3 
ti, ta, ..., t,) can be regarded as a family 


{fits Sas (X15 X95 ee Xm) = (x1, XQ, e285 Xm: bh, to, eo ey tn)} 


of functions of m variables x,, Xo, ..., X,,, each of which is defined 
by a set of 7 values of another group of variables t,, t.,..., t, — called 
“parameters”. We shall confine ourselves to the case of a system 
{ f(x) = (x, t)} of functions of one variable x, depending on one 
parameter ft; ¢ takes any value from aset T of the numerical axis E£,, 
while every function f(x) 1s defined for x of the set X € E, (the 
general case of m parameters and m variables is investigated similarly). 
Let tf) be a limit-point of T. If, given any ¢ and x €_X, the function 
Fx) tends to f(x) as t + ty (t € T), we say that the functions /,(x) are 
convergent on the set X to the function f(x). Given any x € X and 
any number n> 0, we can find a number e, depending on 7 and 
x, € = &(y, x), such that 


lfi(x)~f(x) | < 7 (2.58) 
for 0 < |t—7%,| <e(t € T). 
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For example, let T be the interval (0, ~), and X¥ = (0, 1]; the 
family of functions {f,(x)}is convergent to f(x) on [0, 1] as t + Oif 


sin tx 


(a) Si) = ae I(x) — x: 
(b) Fix) = ¢i + txt, f(x) er ex: 
(c) fy) = x, fa) = 0 for O<x<1l, 


1 for x=1. 


The convergence of { f,(x)} to f(x) on X is said to be uniform as 
i- t) (t € T) if, given any 7 > 0, there exists « = e(n), depending 
on 7, such that (2.58) is satisfied for all x € X when | t--t)| < e (eno 
longer depends on the choice of x). In examples (a), (b), we have the 
case of uniform convergence, and of non-uniform in example (c). 

The following are properties of the uniform convergence of a 
family of functions {f,(x)}: 

1°. If the family {f,(x)} is uniformly convergent on X to f(x) as 
t—+ ty) (t€ T), and {t,} is any sequence of T, convergent to to, the 
sequence of functions { f, (x)} is uniformly convergent to f(x). 

2°. If all the functions f(x) are continuous on X, their uniform 
limit is a function f(x) continuous on X. (See examples (a), (b). In 
example (c), the limit function is discontinuous, which points to the 
non-uniform convergence of {f(x)} to f(x).) 

3°. Let (x, t) be a function of two variables continuous in the rectangle 
asxsa,bstsb,. On writing f(x) = (x, t) for t € [b, 5), 
f(x) = (x, by), we find that the functions f(x) are uniformly convergent 
to f(x) as t ~ by. 


4. Periodic functions of variables. Manifolds of constancy 


Let E, (1 = k sn) bea linear manifold in E,, and f(X) a function 
defined in E,,. We say that E, is a manifold of constancy for the func- 
tion f(X) if, given any X ¢ E, and any Y of E,, we have 


f{(X+Y) =f. (2.59) 


For example, in the case of the function f(x+ y) of two variables 
x and y, the straight line x = — y is a manifold of constancy. For, 
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if we add to the vector (x, y) any vector (x9, —x,) of this straight 
line, the function is unchanged. 

Let us bring in the basis in £,, of elements Yj, Yo, ..., ¥,; Zi, Zo, ..- 
.»+5 Zya_p, Where Y,, Yo, ..., Y, form a basis in the manifold of 
constancy £,. Every element X ¢€ E, can be written in the form 
(see (2.29)) 


X = Y+2Z, 
n=-k 
Ye Ens ZLZ= > Z;Zi; 
i=] 


where 
K(X) = f(%+Z) = f(Z). 


The function f(X) = /(Z) reduces to a function of n—k variables — the 
coordinates Z,, Zo, ..., Z,_, of the vector Z. 

A period of a function of n variables. A period of a function f(X), 
defined on E£,, is vector w (different from the zero 6) such that, for 
any X, 

f(X +m) = f(X). (2.60) 


It follows from (2.60) that all the elements Y ~ 0 of a manifold 
of constancy of a function f are periods of f. A function f(X), having 
a period that does not belong to the manifold of constancy, is described 
as periodic. 

We shall confine ourselves to periodic functions that have no mani- 
folds on constancy. Notice that every periodic function has an infinite 
set of periods (in addition to w, every vector of the form kw, where 
k is any integer, is a period). 

THEOREM 7. If @ and w, are periods of a function f(X), their sum 
®+,, is also a period. 

If @,, Wz, ..., W, are periods of f(X), any vector w of the form 


m 
o> »y N;;, 
i=1 
where n, are arbitrary integers, is also a period. 

The periods @,, @o, ...,@,, form a system of fundamental periods 
of {(X) if all the periods of f(X) are expressible as linear combinations 
with integral coefficients of these periods and are not expressible as 
such linear combinations of a smaller number of periods. 
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EXAMPLE 8. Let us take f(X) = f(%, X_) = sin x, Cos x. on the 
plane E,. It has a system of two fundamental periods, namely, the 
vectors w, (27, 0) and w, (0, 27). We could also take as fundamental 
periods w, and w, = (27, 27) (in which case w, = w3—),). 

THEOREM 8. A continuous periodic function of n variables, having 
no manifold of constancy, has a fundamental system of periods con- 
sisting of not more than n periods. 

EXAMPLE 9, Let, Wo,..., @, be a system of linearly independent 
vectors in E,. Let us form the set A of all vectors (points) of the 
form 

nr 
2 Nghj, 
t=] 
where the 1, are integers. (Such a set is called a net of integers in E,,.) 
We shall write o(X, A) for the distance from the point X € E,, to 
the nearest point of A; 0(X, A) is a function of X. It has a system 
of fundamental periods consisting of the vectors @,, @2,..., @,. 

EXAMPLE 10. A continuous function of a complex variable 
S(x+iy) = P(x, y)+iQ(x, y) (not equal to a constant) cannot have 
more than two independent periods (Jacobi’s theorem). 


5, Passage to ‘the limit for linear envelopes 


Let a), a, ..., @, be linearly independent elements in E. We shall 
write L(a,, d,...,4,) for their linear envelope. If b,, b,, ...,5, 
is another basis in the p-dimensional manifold L(q,,...,a,), then 
L (by, be, - ++» Bp) = Ly (G1, Gey + + 5 Gy) 

Let us consider a family of vectors /,, continuously dependent on 
a parameter «, such that, when a, + x, «, + a(a,a,), the expression 
(lag — /a,)/(@2—%) tends to a vector which we shall denote by dl, /dx. 
We shall assume that /, , and /,, are linearly independent when a #«. 


Having chosen another basis in L(/,,, /,,): 


we have 
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Assuming that the vectors /, and dl,/d« are linearly independent, 
we find that, as «,—a, a—a, then the plane L,f(/,, 4.) = 
=De(Ia,> (lag — /a,)/(%2—%2) ) tends to the plane L,(/,, dl,/dx). 

Given similar conditions (assuming that the systems of vectors 
Lis Igas aeons ba? where no two of the numbers a,, %,...,@, are 
equal, and of the vectors /,, dl,/dx,...,d?l,/d«?, are linearly inde- 
pendent), we find that, as z,-+ «(i= 1, 2,...,p): 


d p= 
| ( meme Eee 5 (1 Flay ooo i's); 


Given a family of functions f,(x), dependent on a parameter a, with 
the same conditions and witha, + a(i= 1, 2,..., p), we find that 


Lifay(*)> fag(*), +++ f(x) tends to Lf), Of,(x)/0x, ..., 


OP-1 f (x)/0x?-1). For example, as «, + x (i = 1, 2,...), we have 


TON COON gach Ot) ee Ee (OO XETRA, Ay Pee), 


L l ] l 4 
P\ x-—a, > x-a" ” x— ay 


L l l ] 
D xXx~—2 ’ (x—2)? 9 ee eg (x—a)? ’ 


Be Xl KP seg Be TAR, XO INK, oie g ke IN x), 


LA |x—a%|, |x-a,|) + LA|x—el, sign|x—a|). | 


Let Ag be an n-dimensional, matrix, 2,, (i = 1, 2, ..., 2) be its eigenvalues 
(simple for « * 0), x,, the corresponding eigenvectors: A aXiaq = AjqXiq> |1X;. []= 2. 
Suppose that & of the numbers A,, (i = 1, 2, ..., ka)tendase — 0 to the eigen- 
value J, of the matrix A,, while the eigenvectors x, (ij = 1, 2,..., k) tend to 
the eigenvector x, of the matrix A,, corresponding to the eigenvalue (,. The linear 
envelopes L, (x, ,,42,....,%, ) now tendtothe linear envelope Ly (x, X0, ~~. 4) 
where x, with i > 1 are augmented eigenvectors of the matrix 4, : 49x%;—ApXy = | 
m X,, (6 = 2.3, ..., k) 


6. Operators from £, into £., 


Let Q bea set in E, (which can coincide with E,, itself); we associate 
with every element X(x,, x, .... x,) of QO an element Y(y,, Yo, .-s Ym) = 
= f(X) of E,,. We say in this case that an operator f is given from E,, 
into £,,, Q being called the domain of definition of the operator. We 
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can also say that we have a mapping f of the set Q of E,, into E,, or 
that the operator f performs a mapping of the set Q from the space E,, 
into the space E,. 


If 
Y=(Q), Qs eee, Ven X = (x, Xo; io Bea). 
Y = f(x), (2.61) 
then 
i= F«X) = Fi(%1 XQy eee Xn) (2.62) 


where f, is a function of variables defined in Q, formula (2.62) 
being the coordinate form of writing the operator f, and (2.61) the 
vector form. The functions f, (i=1, 2,..., m) are called the components 
of the operator f, and we write 


S=(h: Jo ae eon) 


Every set of m functions /,(x;, x2,...,%,) (i= 1, 2,..., m) 
of n variables defines an operator f from E, into E,,, where f= 
Si fascsaghe: 

An ordinary function /(x,, X2, ..., X,) is an operator from E,, into 
E, (into the numerical axis). 

An operator f(X) is said to be continuous in Q if 


Xn X 


nn—oco 
X,, and X belong to Q) implies that 
IX) sae I(X). 


The necessary and sufficient condition for the operator f(X) = (f,(X), 
JAX), «+s F,(X)) to be continuous is that all the functions f{X) = f(x, 
Xg, » ++) X,) be continuous in Q. 

For example, the functions 


Z, = Ji-x}—x3—3§ = VI-N TIP, 
Lo = xy + Xo + X3 

yield an operator from £,(x,, X2, X3) into the plane £,(Z,, Z,), defined 

in the three-dimensional sphere || X ||? < 1 and continuous there. 

Functions of a complex variable provide us with examples of operators 

from E, into E, (mapping of a plane into a plane). 
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The term vector function is occasionally used instead of operator 
from E, into Z,,. An ordinary function of n variables (n> 1, m = 1) 
is called a scalar function of a vector variable; an operator from E, 
into E,, where n> 1, is called a vector function of a scalar variable or 
simply a vector function, and an operator from E,, into E,,, where 
n> 1,m=> 1, is called a vector function of a vector variable. 

Let X¥ = X(t) be a given vector function, where ¢ runs over the 
numerical axis (or a segment of it), and let X be a point of £,,. The 
set of points of E,, of the form X(t) is called a curve or line in E,,. 

Linear operators. A linear operator (mapping) from E,,(X, Xa5...) Xp) 
into EL, (yi, Yes -- +> Ym) iS an operator Y(X) satisfying the conditions: 

(1) Y(X,+X2) = Y(X4)+ P(X); 

(2) the operator Y(X) is continuous. 

It follows from conditions (1) and (2) that a linear operator is 
homogeneous: 


Y(AX) = AY(X). 
THEOREM 9. A linear operator Y(X), where Y = (yy, Voy «++» Vmn)s 
X = (X1, Xq, . 2+) X,), has the form: 


Vix = yy XyHajyXgt 1... +ainxXy G=1,..., 7), (2.63) 


i.e. every coordinate y{X) of the operator Y(X) is a linear function 
Of X = (Xyy Xo5.40 45 Xp). 

Every linear operator Y(X) from E,, into E,, is defined by a rectan- 
gular matrix 


Az=|la;|| G@=12,...,m j=l, 2,..., 0) 
ae (2.64) 


Conversely, every such matrix defines a linear operator from E,, into 
E,, (in accordance with (2.63)). When m = n, a linear operator from 
E,, into E,, is defined by a square matrix A = ||a;,||j'} 

Formula (2.63) is the coordinate form of a linear operator (transfor- 
mation) from E£,, into E£,. 


7. Iterative sequences 


Let 
{X,,} = {Xo, Xi; Xo, oe ‘\, Le = Ca Nn. 2083 Xnk) (2.65) 
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be a sequence of vectors in E,, the corresponding k numerical sequ- 
ences being 


{Xni} = {Xois Xiis Xais -- .} (i = l, 2, 6 ete k). (2.66) 

The vector sequence (2.65) (or system (2.66) of numerical sequences) 
is described as iterative if 

A SI A) i= 1), 2; 3.2 ea)s '(2.67) 


where fis an operator from E, into E,. If f = (fi, fo, . - »f,), equation 
(2.67) may be written in the coordinate form as 


Xni = J Xqeics Xn -1, Qo e229 Xn-1, z) (i = Ls 2: sees k). 
(2.68) 
On putting XY) = (Xo1, Xo2, - + +» Xo), We Can find successively from 
(2.67) or (2.68): 
Xx; = (X41; X190 sey X1p)s Xo = (Xo; X99) «+25 Xor)s eee 


Relationship (2.68) is sometimes written as 


Xni = Finis Xnz -++s Xn, iar Xn-1, i? Xn-1, itts eoes Xn-1, k) 
(2.69) 
(When finding the ith component of the mth vector X,, use is made 
of the components X,,;, Xnq, . + +» Xn, j-1 already found.) 
EXAMPLE 11. K. F. Gauss considered a sequence of pairs of posi:ive 
numbers {a,, B,} (2 = 0, 1, 2, ...) or of plane vectors, where a, 
Bo are given (% = fy), and 


ony tPn— 
An go Sse Pat Bn sf Bs 


As n + oo, the sequences {x,} and {f,} tend to a common limit 
a= lima, = lim B, — the arithmetico-geometric mean of the num- 


nN —> co N-—> co 
bers &, Bo: 
3 
a= a&, =-——, = 
(%», Bo) G 


L c do 
Zo Jo _ %— BB - 42 
a sin* 9 


EXAMPLE 12. Let us take the sequence of partial sumss, = 1+ 
+(x/1!)+...+(x"/n!) of the power series for e*. On writing a, = n, 
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Bn =(x"/n!) we have: (&, Bo, 59) =(0, 1, 1). We get an iterative 
sequence (~,,, B,,, 5,) of the form (2.69): 


x 
ln = titi, Bry ao Pri» Sn = SnciP wn 
n 


The formula provides a unified scheme for obtaining successively 
(a Bas Sy) (i.e. 5, also) forn=1, 2, 3,.... The unified passage from one 
term of an iterative sequence to the next term is very convenient for 
computation on programme-controlled machines. 

Iterative processes. We can generalize the concepts of § 2, sec. 6, 
to operators from E£,, into E,,. 

Let f be a continuous operator from E, into E£,: 


Y=f(X), Y= Ow Yo -++, Vas X = (Xp Xap - ++ Xn), 
or, in the coordinate form: 
Yi = fil%y, Xa +s Xn) (ee ee ere Oe 
Let us investigate the equation 
X = f(X) (2.70) 
or, in the coordinate form, the system of equations 
Ng SF Xi Maye ee (2.71) 
We form the iterative sequence of elements 
Jig Dee haa ais Ags Shes, OS as eee wa en) 
where Xo(Xo1, Xoz - + +» Xpn) iS an arbitrary element of £,, 
Cre ee Le. (m =0, 1, 2, ...), (2.72) 
and in the coordinate form 
Mop sega I Rais Sess. ing 85) Des) (Sle 2 ees - (2:73) 


If the sequence X,, is convergent to X¥*, X* is a solution of equation 
(2.70). 


The solution X* is called a fixed point of the transformation Y= f(X). 
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8. The principle of contraction mappings 


We introduce a norm into the space E,, (see § 1, sec. 2). An operator 
(transformation) f from E, into E,, is said to be acontraction mapping 
if there is a constant g (0 < g < 1) such that, for any X, X,¢€ E,, 


WfAD-ACO I S @ Il 4 —-X I]. (2.74) 


The following theorem provides a condition for the existence of a 
fixed point of the transformation Y= f(X), 1.e. of a solution of equa- 
tion (2.70), and at the same time, a condition for convergence of the 
iterative process (2.72). 

THEOREM 10. (the principle of contraction mappings). Jf Y = f(X) 
is a contraction mapping (i.e. condition (2.74) is satisfied with q < 1), 
then: 

(1) there exists a solution X = X* of equation (2.70), i.e. a fixed 
point X* of the transformation Y = f(X); 

(2) this solution is unique; 

(3) whatever the initial approximation Xo, the iterative process (2.72) 
is convergent to the solution X*, 

X* = lim Xp. (2.75) 
M—> co 

(4) the sequence X,,, is convergent to X* as fast as the convergence of a 

geometric progression with ratio q, in fact, 


IX*=Xpll = FM —Yoll (2.76) 


We shall mention some sufficient conditions for an operator to be 
a contraction mapping under different norms. It 1s assumed that the 
functions f,(X) = fi(%1, Xe, .. +, X,) — the coordinates of the operator 
(X) — have continuous partial derivatives with respect to all the argu- 
ments. 

For condition (2.74) to be satisfied, (also the consequences of the 
theorem), it is sufficient that: 

(a) in the Euclidean metric, 


y . _— =sq<l; (2.77) 


i=1 j=1 Ox; 
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(b) in the metric mp) (see p. 97), 


BOL, (Side Nase bay Oem) 


= g;< 1 (ae ae rere) B 
Py Ox, qi ) 


(2.77’) 


Application to the solution of systems of linear algebraic equations. 
Let us take the system of linear algebraic equations 


n 
yi = 2X QyjXj + bj (2.78) 
J= 
or, in the vector form, 
Y = AX+B, (2.79) 
A= |laj||, B= (d,, dg, ..., Bq). (2.80) 


Given any initial vector Xo(Xo,, X02, -- -» Xpn), We form a system of 
vectors Xo, Xy, Xo,..., X. 


eee 
Xm = Xmp Xma---s mn); (2.81) 

where 
Xmo1 = AXn+8B (m= 0, 1, 2,...) (2.82) 


or, in the coordinate form, 
Tr 
Xm+1,i = > AisXmj +5; (i — a ae are 69 n). (2.83) 
j=l 


It follows from (2.77) and (2.77’) that a sufficient condition for con- 
vergence of the vector sequence X,, as m — - to the vector solution 
X*(x}, Xp, +++» Xp) Of system (2.79) or system (2.78) is that 


n n 
(2) ) daj=q<!1 
27=1 J=1 


or 


nr 
0) Ylajl=a<1 i 12.0050) | 

j= 
(q=maxg; i= 1, 2,..., ”), 


the accuracy || X*—X,,|| of the mth approximation X,, being defined 
by (2.76); in case (a) the norm is Euclidean, in case (b) it is m,,). 
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§3. Convex bodies in n-dimensional space 


The theory of convex bodies in n-dimensional spaces was developed 
by G. Minkovskii; it has found applications in numerous problems of 
analysis, geometry and number theory, and more recently in new 
branches of applied mathematics: in the theory of games and in linear 
programming. This theory provided the basis for developing the the- 
ory of n-dimensional normed spaces, the infinite-dimensional generali- 
zation of which plays an important role in analysis. 


1. Fundamental definitions 


A convex set in space E, is one which contains, in addition to two 
points A and B of the set, every segment joining these points. 
Particular cases: a convex domain QO is a domain which is a convex 


set, a convex body Q is the convex domain Q together with its boundary 
I’. Points of the domain Q are called interior, and points of I’ boundary 
points of Q. 

On a straight line, an interval is a convex domain, and a segment a 
convex body; on a plane, the interior of a circle or triangle is a convex 
domain and the circle and triangle (including their boundaries) are 
convex bodies; in three-dimensional space, the interior of a cylinder, 
sphere, cube are convex domains, and the cylinder, sphere and cube 
(including their boundaries) are convex bodies, the sphere and cube 
being bounded convex solids, and the cylinder an infinite convex solid. 

A closed convex set, lying in a k-dimensional plane and not lying 
in any (k—1)-dimensional plane, is called a k-dimensional convex 
body (0= k =n). A point will be described as a zero-dimensional 
convex body. (The empty set 1s also regarded as convex.) 

A convex body (set) may be bounded or unbounded (cf. the above 
examples). We can quote as an example of an unbounded convex body 
a half-space in E,, i.e. the set of points X satisfying the inequality 
({X = C), where f is a linear functional in £,, and C a constant; 
the whole of the space E,, and any hyperplane in it are examples of 
unbounded convex sets. 

The intersection of convex sets in E,, is a convex set, the intersection 
of convex bodies in £, is a convex k-dimensional body (k = n). 
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A convex polyhedron is a closed convex body — the intersection of 
a finite number of half-spaces. 

The convex envelope of a set M in E, is the set Q of points X€ E,, 
expressible in the form 

l 
xX = y AX; (2.84) 
i= 

where / is any integer, / = n, X, are arbitrary points of M, A; are arbi- 
trary non-negative numbers satisfying the condition 


EXAMPLE 13. The convex envelope of a pair of points A and B 1s 
the segment joining them; the convex envelope of three points not 
lying on a straight line is a triangle; the convex envelope of four points, 
not on the same plane, is a tetrahedron with vertices at these points. 

The convex envelope of a set M is the intersection of all convex sets 
containing M, or the least convex set that contains M. Every bounded 
convex polyhedron is the convex envelope of a finite number of 
points — the vertices of the polyhedron. 

Limit points. A point A is a limit point of a convex body Q if A 
is not an interior point of any segment belonging to Q. 

Every limit point of Q is a boundary point of Q; but not every bound- 
ary point is a limit point. For example, only the vertices of a polyhe- 
dron (polygon) are its limit points. In the case of a circle and sphere, 
all the boundary points are limit points. In future, a convex body will 
be taken to mean a bounded convex body. 

A convex body Q is the convex envelope of its limit points. 


2. Convex functions 


A function f(X) = f(x,, x2, ..., X,), defined in E,, (or ona convex 
set O of E,), is described as convex if, givenany X and Y of E,, (of Q), 
we have 


i) = SIA +MY (2.85) 


(and concave, if the reverse inequality is satisfied). 
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A convex function also satisfies the more general inequality: 


fid—)X4+tY] s (1-N f+ HT) (2.85 
for any ¢ € [0, 1). 
(See Chapter I, § 3, sec. 17, for convex functions of one variable.) 
If f(X) is a convex function, cy is a lower bound in E,, (in Q), the 
set of points of E,, (of Q), satisfying the inequality 
{Xs ¢, 


with any Cc = Co, is a convex body (set). 


EXAMPLE 14. On the plane E, (x, x.), the functions 
Fo(Xrs %2) = (| x4 [P+ | x2 |?) 


with p = 1 areconvex functions. Asp ~, f,(x;, x,) tends to the function f.,(x;, X2) = 
= max({x,|, | x21) (see Fig. 2). The sketch illustrates the curves f,(x;, x;) = 1 
for different p. They all pass through the points A, (1, 0), A,(0, 1), A;(—I1, 0), 
A, (0, —1). 


Fic. 2. 


The curve f.,(,, x.) = 1 is the boundary of the square with vertices A,, A>, 
A;, Ax. 

The curves f, = 1, where J] < p < ~, lie between these two curves. 

The curve f, (x,, x2) =1 is the circle of radius 1. 
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The figures f, = 1, bounded by these curves, are convex. When p<1, such 
figures are no longer convex. For instance, when p = 2/3, we get a figure bounded 
by an astroid. 


3. Convex bodies and the norm of a vector 


Let Q be a convex body in £., having @ as an interior point. Every 
point X of £, can be written (uniquely, when X¥ # 6) as X = AX), 
where A> 0, Xp is a point of the boundary of Q. If X lies outside Q, 
then A> 1; if X liesinsideQ, A < 1;if X lies on the boundary of Q, 
A = 1. The point 6 can be written as 0.X 4 (i.e. A = 0 for the point 0). 

We now define a function yQ(X) in £, as follows: at the point 
X = AX), 

Q(X) = 4; 


Pg(X) is greater than, equal to, or less than 1, depending on whether 
X is outside, inside, or on the boundary of Q respectively, 


PQ(8) = 0. 


PQ(X) is a convex function. The body Q is the set of points of £,, for 
which 9,,(X) = 1, while the boundary of Q is defined by the equation 
P(X ee 

P(X) has the following properties: 

(1) Q(X) = 0, where yg = 0 only when X = 6; 

(2) When dA & 0, p9(AX) = Ap (X) (implying a positive homogeneous 
function); 


(3) Pa(X+Y)S Hq (X)+ Hq (¥). 

If Q is a central symmetric convex body with centre at 6 (i.e. X € O 
implies —.X € Q), we have the additional property: 
Property (2) becomes the stronger property: 

(2’) PQ(AX) = | Al Q(X) 
for any real 4. If p is a given function satisfying conditions (1)-(3), 
the set QO defined by y,(X) = 1 is aconvex body, while it is a centrally 


symmetric convex body with centre at 6 when condition (2’) Is 
satisfied. 
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The Euclidean norm || || of the vector Y € E,, satisfies conditions 
(1), (2’), (3). We can generalize the concept of norm of a vector in 
n-dimensional space: the norm can be taken as any function 9(X) 
that satisfies conditions (1), (2), (3). We shall write E, , for such a 
space. 

If || X || = ~(X), conditions (1) - (3) can be rewritten as: 


(1) || X]| = 0, and || X || = 0 only when XY = 0; 
(2) When A> 0, we have ||AX]| = A]| X]|; 
(3) || X+Y]| = || XU+ [| Y]] (the triangle inequality). 


When ¢ is even, condition (2) is replaced by the stronger one: 
(2’) [AX |] = [A] |] XT (for any A). 


Spaces £,, in which a norm is introduced, satisfying the above 
conditions, are said to be normed. For instance, Euclidean spaces are 
normed (see § 1, sec. 7). 


4. Support hyperplanes 


n 
Let us take the linear form fX = } J.x,in £,, the hyperplane 


tm] 
(fX = C) and the half-space (fX = C). We call ({X = C) a hyperplane 
of support for the convex body Q if Q lies wholly in the half-space 
(fX = C) and the hyperplane has points in common with the boundary 
of QO. 

EXAMPLE 15. In the two-dimensional] case, the hyperplanes of support 
reduce to lines of support. In the case of a circle, the lines of support 
are the same as the tangents. In the case of a triangle, the lines of 
support are the three lines along which its sides lie, together 
with all the straight lines passing through its vertices and lying in 
its exterior angles. In three-dimensional space, hyperplanes of sup- 
port become planes of support; for a sphere, the planes of support 
are its tangent planes, and for a cube, its boundary planes and the 
other planes that pass through the intersection of two sides, or 
merely through a vertex and do not cut the interior of the cube. 

Let the equation of the hyperplane of support be 


IX =C. (2.86) 
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THEOREM 11. The number C on the right-hand side of (2.86) is defined 
by the equation 


C = max fX. (2.87) 
XEQ 


The equation of the hyperplane of support therefore has the form 


FX = max fx. (2.88) 
XEQ 
THEOREM 12. The linear function fX attains its maximum C on Q 
at a limit point of Q, i.e. the intersection of (f{X = C) and Q contains 
a limit point of QO. 
CoroLLary. Every hyperplane of support of a body Q passes through 
one of its limit points (in particular, each hyperplane of support of a 
polygon passes through one of its vertices). 


5. Support functions and conjugate spaces 


Let the norm || X|| = 9,(X) be introduced into space £,, and let 
Q be the closed unit sphere: Q = (|| X|| = 1); Q is a convex body in E,,. 
If 
nr 
1X = > 1X; 
i=1 
is a linear form in £, = £,,, the corresponding hyperplane of support 
of Q is given by the equation 


IX = C(= max /X),. (2.89) 
XSL 
Every linear form /X is a vector / with components /,, J, ..., /,. The 
set of such forms makes up an n-dimensional linear system Z,. A norm 
can be introduced into L,, i.e. we can put 
Zt* = pO= max 1X, (2.90) 
[|X|] =1 
This norm satisfies, along with the norm || X]|, conditions (1), (2), 
(3) (see sec. 3) or (1), (2’), (3). 
We have: 


[AX] ss PEF A]. (2.91) 
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This inequality is a generalization of inequality (2.7) for the Euclidean 
metric. Equation (2.89) can be written as 


IX = |\1II*. (2.92) 


Conjugate Spaces. The space L, = E,, thus introduced, of linear 
forms in E,,,, is described as conjugate to the initial space E,,,. 
The following notation is used: 


Es = Lae (2.93) 
The conjugate to a Euclidean space is also Euclidean. 


THEOREM 13 (Minkovskii). If the spaceE,,, is regarded as the initial 
space, its conjugate becomes E,,, 


Eny = Eng (2.94) 


(the conjugate to the conjugate space is the initial space). 

The reciprocal property whereby spaces E,, and E,, are conjug- 
ates of each other is known as reflexivity. Functions p(X) and (J) 
are said to be reciprocal; they are connected by the relationships 

max 1X = y(I), max LY = 9(X). (2.95) 
e(X)=1 et) 1 
Similarly, the convex bodies Q and Q*, defined by the inequalities 
pX = 1, pl = 1, are also said to be reciprocal. (Minkovskii’s theorem 
is no longer in general true for infinite spaces.) 

EXAMPLE 16. Let /, ,(p = 1) be an n-dimensional space with the 

norm 


XII = e be py. 


When p> 1, we have J, , = 1, ., where (1/p)+(1/g) = 1. 
When p = 2, (the case of a Euclidean norm) we have gq = 2 (the 
n-dimensional Euclidean space /, , is self-conjugate: a In, 2) 
EXAMPLE 17, Let /, , be an n-dimensional space with the norm 


WX = > Isl 


and m, an -dimensional space with the norm 


HY || = max(ly.|, [yel, ~-->s I¥nl); 
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we have: 
x —_— * _ 
eg 1= My, mM, = Ih). 


Every linear function YX in E,, can be regarded as the scalar 
product of a vector X of E,, and Y of E,,. 


6. Fundamental theorems on support hyperplanes 


THEOREM 14. Let Q be a convex body in n-dimensional space E,,. 
A hyperplane of support of Q can be drawn through every point of 
the boundary of Q. 

The following is a generalization of this theorem: 

THEOREM 15. Let L, (k < n) be a k-dimensional plane drawn through 
an interior point A of the n-dimensional convex body of E,,. It cuts from 
Q ak-dimensional convex body Q,. Let L,_, be the (k—1)-dimensional 
plane in L, which is a support plane for Q,. An (n—1)-dimensional 
hyperplane L,,_, can be drawn in E,, which is a support hyperplane for 
QO and contains L,_,.- 

Let /,X be a linear form in the k-dimensional manifold F, Cc E£,, 
(1 = k < n). The linear form /,X in the whole space £,, is called an 
extension of the form /, if, for X € E,, 


[L,X = [yX. 
The form /, in L, has the norm 


Wee lo. = max IX. 
[| X|}1, XE Ey 


The form /, in E, has the norm 


fall = Walle, = max IX. 
| X12 
It follows from this that ||/,|| = ||4,|l,,, ie. when a linear form is 
extended, its norm can only increase. 

THEOREM 16. Any linear form 1,X, defined in a k-dimensional manifold 
L, of E,, 1 S k <n, can be extended to the whole of space E,, without 
changing the norm. 

This theorem can be extended to infinite spaces (the Hahn—Banach 
Theorem). 
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7. The connection between reciprocal convex bodies 


Let Q and Q* be unit spheres in E, and E, . A duality (not one-to- 
one) can be established between the points of their boundaries. 
Equation (2.89) of a plane of support of Q in E,, can be written as 


nr 
YX = 2, Yoi% = 1. 
i= 


In this case (see (2.92)), || Y,|{* = 1. Formula (2.92) becomes 
i | oe — ae (2.96) 


We associate with every point X, of E,, for which || X || = 1 (ie. 
points of the boundary of Q), all the planes of support of Q passing 
through it, these planes having equations of the form (2.96). We have: 


Yo Xo = |, [| Xo || == I| Yo ||* = 1. (2.97) 


Formula (2.97) yields an expression for the Y, €*,, which correspond 
to a given X, €£,; it has symmetry with respect to X, and Y, 
which points to the reciprocity of this mapping. 
Theorem 14 shows that every X, of the boundary of Q (||X,||= 1) 
has at least one associated Y, of the boundary of Q* (||¥||* = 1). 
EXAMPLE 18. On the plane m,, the sphere 


({[ X|] = max ([41[, [x2/) = D 


is the square O= B,B,B,B,; on the plane /,.,, the sphere (||¥||= 
=|y,|+ |_| Ss 1) is the square O* = A, A,A3A,. Corresponding to the 

point X, (1, 1) = B, of the boundary of the square Q, we have the 
Yo(}1, 2) for which 


1 = YoXy = YyXy+)oeX%2. =Mtyes WlVYoll = |nltinal=1L 
1.€. y= || = 0, Yo=lye| = O. 


These points thus fill the side A,A, of the square Q*. 

The side B,B, of the square @ lies on the support line X, = 1, i.e. 
1.X,+0.X_, = 1. The corresponding point is Y,(1, 0) — the vertex A, 
of the square Q*, The remaining sides of Q* correspond to the remain- 
ing vertices of Q, the vertices of Q* to the sides of Q and vice versa. 

In three-dimensional space the convex bodies Q and Q* can only be 
convex polyhedra simultaneously, the vertices of Q being associated 
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with the faces of Q*, the ribs of Q with the ribs of Q*, the faces of 
Q with the vertices of Q* and vice versa. Such polyhedra are said 
to be reciprocal. For instance, if Q is a cube, Q* is an octahedron (and 
vice versa); if Q is a dodecahedron, Q* is an icosahedron (and vice 
versa). 

In the n-dimensional case Q and Q* can only be polyhedra simul- 
taneously, the k-dimensional faces of OQ (0 =k S n—1) being associat- 
ed with the (n— k— 1)-dimensional faces of Q*. 


8. The cone. The tangent cone 


A cone K in E, with vertex at Xp € E,,is a set of points of E£,, differ- 
ent from the whole of £,, and such that, if X belongs to K, the entire 
ray (tX), 0S t < , belongs to K. We shall assume without any 
proviso that the cone K is a convex body. A cone, together with two 


Fic. 3. Fia. 4. 


of its rays forming an acute angle, contains the entire angle. Cones 
on a plane are angles not exceeding z. In three-dimensional space 
examples of cones are provided by dihedral angles not exceeding 2, 
ordinary circular cones or regular pyramids, continued indefinitely, 
etc. 

Let X, be a point of the boundary of a convex body Q in E£; let 
us write K(X,) for the least cone with vertex at X, that contains Q; 
this cone consists of all the rays joining X, with points of Q and all 
the limiting rays. We shall call the boundary of this cone the tangent 
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cone hypersurface to Q at the point X 5; two cases are possible: 

(1) The cone K(X) coincides with the entire half-space, its 
boundary is the unique hyperplane of support at X, to Q, which 
“touches” Q at the point Xp. 

(2) The cone K(X,) is a regular part of the half-space; an infinite set 
of hyperplanes of support of Q passes through the point X,. Such a 
point will be called a point of sharpening. 

EXAMPLE 19. On a plane, thecone K(X,) becomes an angle bounding 
two tangents to Q at the point X, = 0 (the rays OA, OB in Fig. 3); 
if this angle is equal to x, both rays form a unique support line (the 
line A’B’ in Fig. 4), tangential to the boundary of Q at the point O. 
If the angle is less than x, the point O is a point of sharpening, and 
an infinite set of support lines pass through O. 

EXAMPLE 20. Let Q be a convex polyhedron in £,. If the point XY) 
lies inside a face, K(X)) is the half-space bounded by the plane of the 
face, which is the unique support plane of Q at Xp. If X, lies inside 
a rib AB, K(X,) is a dihedral angle less than 2, formed by the planes 
of the faces that intersect in AB; there is an infinite set of support 
planes to Q at Xp, all of which pass through the rib AB. If X 1s a vertex 
of Q, K(X,) isa polyhedral angle with vertex at X 5, bounded by the 
planes of the faces that meet in X); points of the ribs, and all the more 
the vertices of Q, are points of sharpening. 


9. Helly’s theorem 


An interesting theorem on the intersection of convex bodies must 
be mentioned. 

THEOREM 17. Let {Q} be an arbitrary set of convex bodies given in 
E,, at least one of which is bounded. If any n+-1 of them have a common 
point, there is a point common to all the bodies of {Q}. 

For instance, if an arbitrary set of segments, such that any pair 
has acommon point, is given on a straight line, there is a point common 
to all the segments. 
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10. Linear operations on sets 


DEFINITION. Let A and B be any sets of E,,. The vector sum A+B of 
these sets is defined as the set (X) of points of E,, expressible in the form 
X = X,+X., where X,€ A, X, € B. 

EXAMPLE 21. If A 1s an arbitrary set, a a point (vector), then A+ a is 
the set obtained by parallel displacement of the set 4 along the vec- 
tor a. 


EXAMPLE 22. If A is the x-axis, B the y-axis, A+ B is the entire plane. 

EXAMPLE 23. If A in £, is an n-dimensional closed sphere of radius 
o with centre at 0, A+Bisa “layer” of thickness 0 round B, i.e. the 
set of points of £,, at a distance less than or equal to 0 from B. 


THEOREM 18. The vector sum of convex sets (bodies) is a convex 
set (body). 


DEFINITION. Jf A is a number, A aset in E_, 4A is the set of all points 
of the form AX, where X € A. 

A similitude transformation of the set A with transformation coeffi- 
cient A > 0 is a transformation of the set A into the set AA. A symmet- 
ric mapping of A with respect to the centre # is a transformation of 
A into —A. 

When A = 0 the set AA consists of the single point 0. 

If A is a convex set (body), AA is a convex set (body). 


n 
If A; (i = 1, 2,..., m) are convex sets (bodies), )’ 4,A; is a convex 
in 
set (body) for any system of non-negative Suintbers Ais: Bog hain Ags 
Let T, (1 = C,) and T, (/ = C,) be two parallel hyperplanes of support 
of the convex bodies Q, and Q,, while (/, = C,), (4 S C,) are the corres- 
ponding half-spaces containing Q, and Q, respectively; t,, t, are arbit- 
rary positive numbers. Now, t,7,+¢,7, 1s a hyperplane of support 
parallel to them (/ = ¢,C,+%C,) of the body Q = 1,0,+1,Q., lying 
in the half-space (/ S t,C,+1,C,). 

THEOREM 19 (Brunno-Minkovskii). Let A, and A, be convex bodies 
in E,, and A, = tA,+(1—f)A;, 0 S t S1, a “linear system” of convex 
bodies; the n-dimensional volumes J, of the bodies Ay, A, and all the 
A, are connected by the Brunno—Minkovskii inequality 


VI lA) = (L—1) VI n(Ao) tt In(Ap- (2.98) 
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The case of equality occurs if and only if Ay and A, are homothetic convex 
bodies, i.e. one is obtained from the other by a similitude transformation 
and parallel displacement (A, = tAyg+5, t = 0, b is a vector). 

Inequality (2.98) was proved by Brunno (in 1887); the case of 
equality was proved by G. Minkovskii (in 1891). 

Inequality (2.98) implies that VJ,(A) is a concave function for any 
tin [0, 1). 

The theorem still holds for non-convex bodies, and in general for any sets, 


if J,(A) is understood as the exterior n-dimensional measure of the set A or the 
measure when it is measurable (see ref. 7). 


The Brunno-Minkovskii theorem is employed in proving the iso- 
perimetric and numerous other geometric properties of convex bodies. 


CHAPTER III 


SERIES 


Introduction 


Infinite sequences and their limits have been discussed in Chap- 
ter I. Infinite series, or simply series, are closely connected with 
sequences, e.g. 


oo 


Q+dg+ ...+a,+...= Y a, (3.1) 


n=) 


is “the sum of an infinite number of terms”. 

Series are commonly employed in the most widely spread branches 
of mathematical analysis and in the solution of applied problems, 
since they represent one of the most universal and effective means 
both of investigation and computation. 


Examples of series (infinite geometrical progressions) were known to the 
mathematicians of antiquity. In the process of developing the analysis of infinitesi- 
mals, series made their appearance, with the aid of which the values of various 
functions could be computed: Mercator’s series for the logarithm, Newton’s 
series for sin x, cos x, arc sin x, arc cos x, (1+x)®, etc. Series were widely used by 
Euler for representing functions in various works; in addition to power series, 
trigonometric series were employed by Euler. He also made use of divergent 
series, and seems to have been the first to be concerned with improving the converg- 
ence of series. The vast amount of factual material on series that had accumulated 
by the beginning of the nineteenth century posed to scientists the problem of 
finding a strict basis for the theory of series. The investigations of Abel, Gauss, 
Cauchy and others in this direction played an important part in laying the foundat- 
ions of mathematical analysis as a whole. 


The present chapter is devoted to the basic theory and practice 
of evaluating series. Numerical series are considered in § 1, functional 
in § 2, and the various methods of computing them in § 3. (See 
Chapter IV for vector series.) 
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1. Basic concepts 


DEFINITION: A_ series is defined as in (3.1), composed 
terms of an infinite sequence {a,} (n = 1, 2, 3, ...). For 
series there is a corresponding sequence {s,} (n = 1, 2, 3, 
partial sums, where 


n 
$= a, $2, = Atay, ..., Sn = Dans - 
=] 


EXAMPLE 1. Given the series 


of the 
every 


ae J OOF 


(3.2) 


The following two cases are possible when considering the sequence 


of partial sums. 
Case 1. The sequence {s,} has a definite finite limit 


S= lim s,. 
TN —> oo 


This limit is called the sum of series (3.1) and is written as 


s= S' dp. 


nel 


2 /1\"m1_ 3 
= = =, 
(sy) =3 


Case 2. The sequence {s,,} has no finite limit. 
EXAMPLE 2. 


In Example 1, 


1+24+3+...+n+...= J) n; 


$= 41, Sa 3, oe ey Sn 9) end 


As n— oo, the partial sum s, — o. 


(3.3) 
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EXAMPLE 3. 
iia Ss 
n=1 
O when n is even 
Ss =1, 5&5 =0, 5S = 1,....,5, = 
s . : i 1 when nis odd. 
EXAMPLE 4. 
1-24+4—-8+...= ¥ (—2)*1; 
n=l 
1—(-—2)" 
$1, So = —l, Sy = 3, S$. 93.2245 gy = 


In Case 1 the series is said to be convergent, whereas it is divergent 
in Case 2 (Examples 2, 3, 4). 

Example 2 illustrates an important particular case of a divergent 
series, when 5, oo (or s, +— oc); Example 3 illustrates the case 
when 5,, oscillates while remaining bounded, and Example 4 the case 
when s,, oscillates but is unbounded. 

We shall only discuss convergent series in this section. In the case 
of a convergent series (3.1), the sum S can be written as 


S = s,+R,, (3.4) 
where 
Rn = AngitGngat---= dD) ap (3.5) 
hk=n+1 
is called the remainder or remainder term of the series. 

Evaluation (or summation) of a series implies finding its sum S. 

We must therefore verify the convergence of a series before finding 
its sum. 

Strict summation (some methods of which will be given below) 
is only possible for a narrow class of series. For the majority, the 
sum 1s found approximately. In approximate summations, the sum 
S is replaced by the partial sum s,. 

It follows from the definition of the sum of a convergent series 


that 
lim R, = lim (S—s,) = 0. (3.6) 
N—> oo 


R—> 99 
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This indicates that, given a sufficiently large m, the absolute value 
of the remainder term R,, can be made as small as desired. 

To ensure the required accuracy when replacing S by s,, it becomes 
necessary to estimate the difference 


S—s, = R,, 
1.e. the remainder term. 

In addition, practical convenience in computations requires that 
the number n of terms of the partial sum s,, required for achieving 
the necessary accuracy, be not too large. Reasonably accurate summa- 
tion of certain series would require taking thousands, or even tens 
of thousands, of terms. Such series are said to be slowly convergent. 

EXAMPLE 5. To compute the sum of the series 


l l I = ] 
eee aoe ee en) a 
n=] n 


2°34 
to an accuracy of 0-001, the summation of a thousand terms is needed. 
The question thus arises of improving the convergence of a series, 
i.e. transforming it in such a way that summation of the transformed 
series with the Same accuracy requires a smaller number of terms 
in the partial sum s,. The fundamental questions for the summation 
of series are therefore: convergence, estimation of the remainder 
term, improvement of the convergence. 


2. Some convergence tests for series 


Cauchy’s test for the convergence of a sequence (3.2) takes the 
following form as applied to series. 

CaucHy’s TEST. The necessary and sufficient condition for converg- 
ence of the series (3.1) is that, given any e>O, there exists ann, such 


that 
l@ngit@nge2+ ate + 4n+m| Sie 


for alln>n, and any integer m. 
An important corollary follows from this test with m= 1. 
If series (3.1) is convergent, its general term a,, tends to zero as n 


increases: 
a,>+Q0 as n+ o, 
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This condition is necessary but not sufficient for convergence. 
EXAMPLE 6. The harmonic Series 
1 1 a | 
lt s+3+ s ae 
is divergent, although a2, = 1/n +0 as n + ov. 

Cauchy’s test is the most general necessary and sufficient criterion 
for the convergence or divergence of a series. 

Direct application of it is difficult, however. The theory of series 
includes a whole range of sufficient tests for convergence and diverg-. 
ence of varying degrees of generality, and widely employed. Histor- 
ically, the first of these is 

D’ALEMBERT’S TEST. Jf the limit 


exists for series (3.1), the series is convergent when q<1 and divergent 
q> 1. (The test is inconclusive when q = 1). 

A more general test is 

THE CAUCHY-HADAMARD TEST. We write 

q= lim fe, | Qn, | . 
Tl —> co 

Series (3.1) is now convergent when q~<1 and divergent when q> 1. 
(The test is inconclusive when q = 1.) 

THE PRINCIPLE OF MAJORANT SERIES. The series 


bt+bat+...= Y db, (3.7) 
n=l 
with non-negative terms b, is said to be majorant for series (3.1) if, 
given any 7, 
|a,| = by 

as from some n= N., 

The convergence of series (3.7) implies the convergence of series 
(3.1). 

Numerous convergence tests are based on the principle of majorant 
series, including in particular the d’Alembert and Cauchy—Hadamard 
tests. 
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§ 1. Numerical series 


1. Alternating series and series of constant sign 


If all the terms of a series are of the same sign, the series is said 
to be of constant sign. Such series include those, all the terms of 
which are positive (positive series), and those, all the terms of which 
are negative (negative series). 

If all the terms of a series are not of the same sign, the series is 
described as alternating. When there is a finite number of terms of 
the same sign, they can be neglected when investigating the converg- 
ence and attention paid only to the remaining series of constant 
sign. The theory of series with an infinite number of positive and 
negative terms has certain differences in principle from the theory 
of series of constant sign. 

The following is a particular case of the principle of majorant 
series. 

THEOREM 1. The series 


Aj+d,+ ...+4,+...= ) ay (3.8) 


Qr=l1 


with terms of arbitrary sign is convergent if the Series 
fa,|+la,[+...+]a,]/+...= d, | an (3.8*) 
Thm 


formed from the absolute values of the terms of series (3.8), is convergent. 

In this case series (3.8) is described as absolutely convergent. All 
series of constant sign are absolutely convergent. 

Cases are possible when series (3.8) is convergent, and series (3.8*) 
divergent. Series (3.8) is then described as non-absolutely, or condi- 
tionally convergent. 

EXAMPLE 7. The series 


1 1 a (-I™" 
I-s4+z- = 


1s convergent and its sum is S = In 2. 
On the other hand, the series of the absolute values of the terms 
is the divergent harmonic series. 
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2. Properties of convergent series. The associative property 


If the terms of the convergent series 


Atdgt...ta@,+...= Da, 


are grouped in any manner, without changing their order: 


at eee + ap,, Any4it oee + Qn,, Ansti t eee + ans, ee 
e9 Anyi tit eee +Q,, eeeg 


where {n,} is a partial increasing sequence of numbers of the natural 
series, the series of the sums of the terms of these groups 


(Q,+ 2... +Qn,)+(Qnj4it ..- $On J+... 


is always convergent and has the same sum as the initial series. This 
property can be utilized for improving the convergence of series. 
The rearrangement property of absolutely convergent series. If the 


series )}) a, is absolutely convergent, the series obtained from it 
nel 

by any rearrangement (commutation) of the terms is also convergent 

and has the same sum as the initial series. ; 

Non-absolutely convergent series do not have the commutative 
property. We have, furthermore, 

THEOREM 2 (Riemann). The terms of a non-absolutely convergent 
series can.be rearranged in such a way that the transformed series 
has a sum equal to any previously assigned number, or becomes di- 
vergent, 


3. General tests for the convergence of series of positive terms 


If we want to determine the convergence of the series with positive 
terms 


x Qks (3 9) 


we choose at discretion another series with positive terms 


yp (3.10) 


R=} 
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such that its convergence and sum are already known to us. 
We introduce the notation: 


Rm = Yap; (3.11) 
kam 


R,, is the remainder term of the series, which is equal to a finite posi- 
tive number if series (3.9) is convergent, and to oo, if series (3.9) 
1s divergent; 


b 
A,() = ae . (3.12) 


where / is a parameter taking integral values such that m+/=2 0, 
m is a fixed positive integer; 


lim A,(/) = AQ, (3.13) 

k= oo 

Jim A,(D = A()). (3.14) 
Let 

lim )' by= Bm (3.15) 


fim Y by = Bri (3.16) 


in the case when the lower and upper limits coincide, i.e. when the 
limit exists, we introduce the notation: 


ao A,{1) = A()), (3.17) 


lim > by= By (3.18) 


n-—>co hum 


We have the following sufficient tests for convergence of series 
(3.9). 

Test I. If A() > 0 and B,, < + ~, series (3.9) is convergent, whereas 
if —o <A(l) S 0 and B,, = — @, the series is divergent. 

Test Il. Uf AD) <Q and B., > -— oo, the series is convergent, whereas 
fos A()) < + co and B., = + oo, the series is divergent. 
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Test Ill. If A() > 0 and B,,<+- or A(l)<0 andB,> — ~, the 
series is convergent; if0 SA(l) <+ and B,=+ ~or—0< A()S0 
and BL. = — ~, the series is divergent. 

By a suitable choice of auxiliary series (3.10), we can obtain 
as particular cases from Tests I, II and IJ] either new or already 
familiar sufficient tests for the convergence of tests with positive terms 
(see sec. 5). These tests include, in particular, the familiar necessary 
condition for convergence which says that, if series (3.9) is convergent, 

lim a, = 0. 
N—> co 


4. Remainder term estimates corresponding to the various 
convergence tesfs 


When one of the convergence Tests I, II, III is satisfied for series 
(3.9), a corresponding estimate of the remainder term can be given. 
(1) For Test I: 


Bin Bn 
inf A) = "+! = “sup A,(!) ° ee 
k=m k=m 
where m is such that all the A,(/)>0; / is an integral parameter, 
satisfying the condition m+/ = 0. 
(2) For Test II: 


Bm Bm 
“inf A,(/) = Rust = “sup A,(1)’ (3.20) 
k=m k=m 
where m is such that all the A,(/) < 0 and m+/20. 

(3) For Test III, if A()>0, inequalities (3.19) hold, while (3.20) 
hold if A() < 0. 

For Test III, it becomes convenient to utilize the following par- 
ticular cases of (3.19) and (3.20): 

(a) When A(J)> 0 and the sequence {4,(/)} is monotonically in- 
creasing for k = m, we have 


Brn Bm 
AQ = Amt = ee 
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(b) When A(/)<0 and the sequence {A,(/)} is monotonically 
decreasing for k = m, we have 
By, BA 
AO AD 
(c) When A(J)<0 and the sequence {A,(J} is monotonically 
increasing for k = m, (3.21) holds. 
(d) When A(/) > 0 and sequence {4,(/)} is monotonically decreasing 
for k = m, (3.22) holds. 
EXAMPLE 8. Let us estimate the remainder term of the series 
a | 


d=: 


(3.22) 


nel 
On putting, say, b, = 2,_,—Z,, where z, = —1/2n?, we have, 
provided that m> 1 and /=0: 
_ Qm+1) (m+ 03 
Am!) = 2m m+1)? ’ 
rn a —— _ ol 
A(t) = —o) Ona = l, By = bm @n+1— 2m) = Dyk” 


It is easily verified that the sequence {A,,(0)} (m = 1, 2, 3, ...) 
is monotonically increasing, while the sequence {A,,(1)} (7m = 1, 2, 
3, ....) 18 monotonically decreasing. 

Consequently, when / = 0 and m = 1, we have by (3.21): 


J (m + 1)* 
ant ~ = ~ Om iy’ 
while with / = 1, by (3.22), 
(2m + 1) (m+ 1) mth” Imi" 
We obtain from the last two inequalities, in choosing the greatest 
lower and least upper values, 
] (m+ 1)* 
maim ~*™ ~ Gna Dm’ 
This example shows that, given the same choice of sequence {b, } and 


different values of the index /, estimates can be obtained that do not 
overlap each other. 
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5. Special tests for the convergence of series of positive terms. 
Estimates of the remainder term 


Numerous familiar classical tests for the convergence of series 
with positive terms follow from the general convergence Tests I, II 
and III (sec. 3). We shall give here certain of these and the corres- 
ponding remainder term estimates (see ref. 9). 

1°. THE GENERALIZED D’ALEMBERT TEST. The following two tests 
can be regarded as a generalization of the d’Alembert test mentioned 
above. : 

Test A. If, for a fixed I, 


A) = fim “2+1—% — 0, (3.23) 
n>co &n+| 


the series ) a, is convergent, whereas the series is divergent if 
n=1 


A) = lim nti Fn (3.24) 


n—> co +l 


Test B. If, for a fixed l, 


A() = lim “eti— 4 
n—+>eo n+] 
is negative, the series is convergent; whereas if the limit is positive, 
the series is divergent. 
In particular, when / = 0 Tests A and B yield d’Alembert’s test 
(Introduction, sec. 2). 


If the convergence of the series } a, is established with the 
n=l 


aid of Test A or B, we have on the basis of (3.20): 


—a —a 

m = Ry, = ————"—__.. (3.25) 
Yi Qh+1— Gp sup Ckt1— 7h 
k=m 4k k=m  4pyI1 


If the sequence {A,(/) = (@,,,—4,)/a,,,} is monotonically in- 
creasing for k = m, we have 


lim wR+17 “k 
Aam+i k~>co pit 


(3.26) 


Qm+1— am 
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If the sequence {A,(/)} is monotonically decreasing for k = m, 
we have 


= R 3.27 
lim Gp+1— 4k ts Q8mn41—am ( ) 
k—->co Opi} am+l 
EXAMPLE 9 
= lh 
ps 7H, 3 (3.28) 


It is easily verified that, if /+1 <0, the sequence {A,() = (a,,,- 
—da,)/a,,,} for series (3.28) is negative and monotonically decreasing 
as from a certain k = N(J). If /+- 1 > 0, the sequence {A,(/)} is negative 
and monotonically increasing. 

We therefore have, on the basis of (3.27) with /+ 1 = 0, as from a 
certain m2 N(/) (say as from m= 1 when /= —1): 


] aoe (m + 1)? 
QM+1=1py2 = Ams 3 2m ¥1=1(m + 1)? (m? + 4m+ 2) ° 
When / + 1> 0 we have to reverse the inequality signs in the above. 
For instance, on putting m+/ = 6, and accordingly assigning the 
following values to m and 7: 


m 9 8 7 6 5 4 
l —3 ~—2 ~] 0 1 2 
it may be seen that the best upper estimate is obtained with / = —1, 


and the best lower estimate with/ = 0, so that in this case 0-000686 = 
= R, = 0-000703. 

2°. THE GENERALIZED CAUCHY TeésT. On putting 5, = 0” and 
applying Tests, I, II (sec. 3), we get the following convergence test, 
which may be regarded as a generalization of the Cauchy-Hadamard 
test. 

Test C. If, for a fixed l and 0 <1, 


nr 
lim > 0, 
n— oo An+| 
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the series )\ a, is convergent; whereas the series is divergent if, 
Rm} 
for a given | and o> 1, 
n 


0 s lim <= oo, 
N-> co n+l 
When / = 0, this test yields the familiar Cauchy—Hadamard test 
(Introduction, sec. 2). 
If the convergence of the series can be established with the aid 
of Test C, we have by (3.19), for any m+/> 0, 
Mm m 
: 0 = Rist = : 
(1—o0) sup —— (1-9) inf — 
h=m 441 h=m Qr+1l 


(3.29) 


Here, 9 <1 is an arbitrary number, for which lim (0"/a,,,)> 0. 
nl—> oo 
If the sequence {A,() = 0*/a,,,} is monotonically increasing for 


k =m, we have 


o™ an +1 
J eke (3.30) 
(1-0) lim —— ae 
k—» co Tp+} 


Whereas, if the sequence {A,(/)} is monotonically decreasing for 
k = m, we have 


m 
vat = Rn = ———_ : (3.31) 
e (1—¢) lim — 
kh Art| 
EXAMPLE 10. 

oo xn 
——= 0Osx< 1). 3.32 
La ) (3.32) 


It is easily shown that estimate (3.31) can be applied to series 
(3.32) on condition that m+/ 2 3. 
On taking 0 = x, we have 


xml xmt 
————<—_—___—— = —— 
(l—x)"*Ym+1 l-x 


3°. RAABE’S TEST. A particular case of the general Test III 
(sec. 3) is 


m+l = 
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Test D. The series )' a, is convergent if, for any integral | = 0, 


nel 
AG = tig Lo 2 (3.33) 
N—> co an+l 
and is divergent if 
A(l) > 0. 


When / = 0, we get 


RAABE’S TesT. The series }\ a, is convergent if 
n=l 


f Qa 
lim n(1—22e2) >] 
Nh—> co ay 
n(1—Sess) <1, 
ay 


= l 
2 mae FD 
The convergence of this series is readily established by applying 
Test D. We can also make use here of the estimates for the remainder 
term of sec. 4, corresponding to cases (3), (c) and (3), (d). 
On applying estimate (3), (c) (sec. 4) with m 2 9, and 1 = 2, we 
get 


and is divergent if 


for all n= ng say. 
EXAMPLE 11. 


(3.34) 


(m— 1) (m+ 3) - m—1 
(m—3)(m+1) (m+1+1)(m+142) Rm = (m+ 1) (m+ 2) * 


(3.35) 


On applying estimate (3), (d) (sec. 4) with m+/> 0, /= 1 and 
m=> 41/(21—3), we have 


(m— 1) (m+ 3) ee m—1 
(2m—3)(m+1)(m+14+1)(m+1+2) — Rm+t = Dm) (n +2) * 


(3.36) 
On comparing inequalities (3.35) and (3.36), say with m+/ = 12, 
it is easily seen that 
0-00315 = Ry» = 0-00337, 
he true value here being R,. = 0-00320. 
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4°. Gauss’s Test. If lim a,,,/a, = 1, d’Alembert’s test gives 
Ni—> co 
no answer as regards the convergence of the series, as mentioned 


above. If the ratio a,,,/a, has the form 


ang, _ M+ pnt? +9(n) 
Qn n*+ qn*—-1 + y(n)’ 


where y(n) and y(n) have lower orders than n*~!, the convergence 
or divergence of the series may be established with the aid of the 
following test. 

Gauss’s Test. The series ) a, is convergent when q—p> 1, 


newt 
and divergent when q—p = 1. 


EXAMPLE 12. When x=1, the hypergeometric series (ref. 7): 


oP, xa+ BB+), a+) @+D8G+4+NG+2) 


Ley L2yytt) Grogs ee 


is convergent provided that 
yoats. 


Notice that, from a certain nm onwards, series (3.37) is of constant 
sign for any real a, 8, y (it is assumed that none of the numbers «, 
B, y is negative). 

We have in the present case, say with / = 0, 


(y—a) (y—8) 


A,(0) = y+n 


—(y—a—B) 


and 
A(0) = —(y—a—f) < 0. 


On observing that, for alln > —v+, the sequence {4,(0)} will be mono 
tonically increasing or monotonically decreasing, and making use 
of (3.26) and (3.27), we get 


(m+v)map, = = ma, 
(m+y¥)(y—-«—B)—(vy—a@) (y—B) = ™ = y-a—B’ 
(m> —Yy), 
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where 
= a(xtl)...(x+m—Il1)B(B+1)...(B+m—1) 
miy(y+1)...(vy+m—]) 
5°. CAUCHY’S INTEGRAL TEST. Let the general term of the series 


ya, be monotonically decreasing with increasing n. Obviously, 
nal 
it is now possible to choose an infinite set of positive functions a(x), 


monotonically decreasing and continuous for x > 0, and such that 


a(n) = @p. 
Let a(x) be one of these functions. The series }' a, is now converg- 
n=l 
ent or divergent, according as the improper integral 
| a(x) dx, (3.38) 
a 


where « = l, is convergent or divergent. 
This test follows as a particular case from general Tests I and 0 
(sec. 3), 1f we put say 


n+1 
b, = | a(x)dx and /J=0. 


EXAMPLE 13. We are given the series 
se l 


Pe nin't*n (a > 0). (3.39) 
We choose as a(x) the function 1/(x In't° x) and put a = 2, so that 


Oe sae re I ees 
, xinttex ~~ ain?x |, =o ln? 2’ 
the series is therefore convergent. 
EXAMPLE 14. We are given the series 
a 
nasninnininn’ 


We choose a(x) = 1/(xInx In In x) and put « = 3: 


(3.40) 


, x Inxininx ‘ 


|, soxems* = InIninx| = oo, 


so that the series is divergent. 
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EXAMPLE 15. Given the series 


Wee (3.41) 


we get: 


oo for osl. 


The series is thus convergent for o> 1 and divergent for o = 1. 
Notice the following points: 

(1) In view of the fact that the choice of the function a(x) is to a 
large extent arbitrary, an infinite set of estimates can in general 
be quoted, corresponding to the test. 

(2) When the sequence {a,} is monotonic, estimates correspond- 
ing to Cauchy’s integral test can be used, independently of the 


particular test used to prove the convergence of the series yay: 
n=]! 
EXAMPLE 16. 


mt 7 (a > 1). 
Let a(x) = x/a*, say. The function a(x) is monotonically decreasing 
for x> I/log a. Therefore, on evaluating 
k k+l a ae as 
Gece va-* dx = £ 1 a-—I\Ina-1] 


k : alna ka \|n* a 


and making use of estimate (3.26), we have 


m(m |In a+ 1) — = Rn 3 Be 
om-Ya—1)(mina+1— 2) Bete 


(m = 1). 
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6°. N. V. BUGAEV’s THEOREM; V. P. ERMAKOV’S TEST. Let a(x) 
be the function introduced in the statement of Cauchy’s integral test, 
and 6(x) some positive differentiable function, increasing as x increases 


and such that lim 1/d(x) = 0. The following theorem can now be 
x—> oo 


obtained on the basis of Cauchy’s integral test. 
THEOREM 3 (N. V. Bugaev). Jf the function 6'(x) a[6(x)] is mono- 
tonic for sufficiently large x, the series ) a, and) 8'(n)a[6(n)] 
n=l n=1 


are simultaneously convergent or divergent. 


Thus any convergent test applied to the series }' 6’(n)a[6(n)) 


n=1 ao 
will at the same time yield a convergence test for the series )' a,. 
n=l 


In particular, we have the following corollary of N. V. Bugaev’s 
Theorem. 
V. P. ERMAKOv’S Test. If 
e™a(e™) 
m—>eo a(m) 


the series ) a, is convergent; whereas if 
n=l 
.  e™a(e™ 
lim (e") 
m—->eo a(m) 
the series is divergent. 


n+1 
On putting say b, = | 6’(x)a [6(x)] dx and using the general 
nN 
tests of sec. 4, an infinite set of estimates can be obtained (for the 


remainder term of the series ) a,), corresponding to different 
n=1 
methods of choosing the functions 6(x). 


7°. LOBACHEVSKII’S TEST. If the terms of the series 


y a(n) 


nel 


are monotonically decreasing, then the series is convergent or divergent 
at the same time as the series 


ee ae 


m=xIl 
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where p,, is given by 
Apm) =2-", apmt+l)=2-. 
We can also define p,, from the equation 
(Pm) = 2-™, 


if the function a(x) is monotonic and defined for any value of x. 
EXAMPLE 17. 


The equation 
1/Pim = 2-™ 
+m 
gives us p,, = 2% ; we form the series 


yy Pm2-™ = y a 
m=1 


m=l 


ws 


This is a convergent geometrical progression, so that the series 
¥ < | 
nal n 

s also convergent. 


6. The convergence of alternating series 


Given the alternating series (3.8), we form series (3.8*) from the 
absolute values of its terms. 

To-establish the absolute convergence of series (3.8), we can apply 
to the positive series (3.8*) all the tests described above for series 
of constant sign. As already mentioned, however, tests for the con- 
vergence of series (3.8*) may not be valid for series (3.8). 

Alternating numerical series. Alternating series are those, the terms 
of which are alternately positive and negative. The following holds 
for such series: 


THEOREM 4 (Leibniz). [f the terms of an alternating series )' a, 
naw 
are monotonically decreasing in absolute value, 


| Qn41| = | ay | (n = 1, 25 D5 tes) 
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and the n-th term tends to zero, 


lim a, = 0, 
Nl —> oo 
the series is convergent. 


Estimation of the remainder term of an alternating series is simple 
and effective. 

The remainder term of an alternating series that satisfies the con- 
ditions of Leibniz’s theorem, 


Ryn = Angi tangat o-+s 
has the sign of its first term @,,, and is less than it in absolute value: 
Ral = Ong. tGngat--s 


The criteria for convergence of Abel and Dirichlet are more general 
than Leibniz’s test. 
Suppose we have the series 


Ds Onby = Ady + Agby+ «6. +aqgbyt .+-, (3.42) 


where {a,} and {b,} are sequences of real numbers. 
ABEL’S TEST. Series (3.42) is convergent if the series 


mo =b+bo+...+b, +... (3.43) 


is convergent, while the numbers a, form a monotonic and bounded 


sequence. 
la,|< K (n = 1, 2, 3,...). 


EXAMPLE ]8. 
sa ] I 1 ] 
E(t-a) a Om = imo h On = gaat 


DIRICHLET’S TEST. Series (3.42) is convergent if the partial sums 
of series (3.43) are bounded in aggregate: 


ls,| = M (= 7 3 s45%), (3.44) 
while the numbers a, form a monotonic sequence tending to zero: 


lim a, = 0. 
N—> oo 
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Assumption (3.44) is more genera] than the assumption of the 
convergence of series (3.43), so that Abel’s test is a consequence of 
Dirichlet’s test. 


7. Infinite products and their convergence 


Suppose we have a sequence of numbers (or functions) 


Py Por P3r +++ Pnv oss (3.45) 
The symbol 
[] Pn = PiP2Ps+-+Pn--- (3.46) 
n=1 


s known as an infinite product. 
The product of a finite number of consecutive terms 


Py = Py, Py = PyPo, Py = PPPs, ---> Pn = PiP2-++Pn-1Pn (3-47) 


is called a partial product. The sequence of partial products will be 
denoted by {P,}. 
EXAMPLE 19. 


co n(n +3) 14 2.5 3.6 


EE Ee ee 
—_— 


il @4D@+2)° 23 34 450°" 


The convergence of infinite products. 
Four fundamental cases may be distinguished. 
(1) The sequence of partial products {P,,} has a finite limit different 
from 0: 
lim P, = P. (3.48) 


=> co 
This limit is called the value of the product and is written as 
P= {| Pr. (3.49) 
n= 
The product itself is said to be convergent in this case. In Example 19, 
1n+3 1 
noo 3 2+] 3- 
(2) The sequence {P,} tends either to + ~, or to — ~. 
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EXAMPLE 20. 
[] n=1.2.3...”...5 P, =n; lim n! =o, 
n=l N—> co 
(3) The sequence {P_} has the limit 0. 
EXAMPLE 21. 
ae for any n, nn, P ini = 0 
Pr = 5 y A, 9 non? Baresi | eae 


(4) The sequence {P,} has no limit (e.g. oscillates). 
EXAMPLE 22. 


as n mn+3) _ 
Ll (-" Gana@ed 


ba f _2-5\3-6f 4.7 lop. 
~ 2.3) 3.4/4.5\ 5.6)°°°? 3 aie Tie 


In the last three cases the sequence is said to be divergent. Case 
(3) ( lim P, = ) implies a different classification to that accepted 


nN-> co 
for infinite series. However, this is convenient for the statement of 


many theorems on infinite products. 
An infinite product can be written in the form 


IT Pa = Pm: (3.50) 


n=] 
where 


Pm = PiP2+++Pm 
is the partial product of the first m terms, and 


Nm = Pm4iPm42++° = I] Pn (3.51) 
n=m+1 
is called the remainder product, this being analogous to the remainder 
term of a series. 
THEOREM 5. If product (3.46) is convergent, the remainder product 
(3.51) is also convergent for any m (if all the p,, # 0); the convergence 
of the remainder product implies the convergence of the original product. 
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Thus discarding a finite number of initial factors or combining 
at the start a finite number of factors has no effect on the convergence 
of an infinite product. 

If an infinite product is convergent, then 

lim z,, = 1. (3.52) 


m—> oo 


This follows from (3.50); 


and from the fact that P ~ 0. 
If an infinite product is convergent, then 
lim p, = 1. (3.53) 


n—> co 


This follows from the chain of equations: 


In the case of a convergent product, p, > 0 as from a certain n. 
This follows from (3.53). In view of Theorem 5, we can assume with- 
out loss of generality that all the p, > 0. 

There is a connection between the convergence of infinite products 
and that of series. 

A necessary and sufficient condition for convergence of the infinite 
product (3.46) is that the series 


x In Pn (3.54) 


n=} 
be convergent. 
If S is the sum of series (3.54), we have 


P= e, (3.55) 
On writing s, for the partial sum of series (3.54), we have 
SIPs Pea en: (3.56) 


It follows from the continuity of the logarithmic and exponential 
functions that, when P,, tends to a finite positive limit P, the partial 
sum s, tends to In P, and conversely, if the finite limit S exists, the 
limit for P is equal to e®, 
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The nth term of an infinite product may be conveniently written 
as 
Pr = 1+, 


and product (3.46) written as 


I] G+a,), (3.57) 


n=l 


while series (3.54) is written as 
¥° In(1+4,). (3.58) 
n=} 


THEOREM 6. If, for sufficiently large n, all the a, > 0 (or a, < 0), 
the necessary and sufficient condition for convergence of product 
(3.57) is that the series 
> Oni (3.59) 
n=] 

be convergent. 

A necessary condition for convergence of (3.57) and (3.58) is that 


lim a, = 0, whence lim mer ard = 1. 
N—> co N—> co ay, 


In the general case a, = 0, the infinite product (3.57) is convergent 
if the series 


oo 


ya. (3.60) 


n=] 


is convergent along with series (3.59). 
The product of Example 19 can be written as 


o  nnt+3) = 2 
[] (n+1)(1+2) — (2 arners ) 


nel nel 
Here 
- —2 
on = GED (+2) 
and 


lim a, = 0. 
N—> o0 
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The following will make it clear why, in the case 
P=0, 


the infinite product is classified as divergent. 

The necessary and sufficient condition for the infinite product to have 
a zero value is that series (3.54) or (3.58) have the sum — ~, 

This is the case for example when a, < 0 and series (3.59) is diver- 
gent, or, when series (3.59) is convergent, but series (3.60) is diver- 
gent. 

Product (3.46) is said to be absolutely convergent when series 
(3.54) of the logarithms of its factors is absolutely convergent. 

An absolutely convergent product has the commutative property. 
The necessary and sufficient condition for absolute convergence of 
product (3.57) is that series (3.59) be absolutely convergent. 

We have, for Example 19: 


nl (nt D420 “(4+ D (+2) me 


But )) 1/n? is a convergent series (see example 15), so that the 
n=1 
product is absolutely convergent. 


It may be remarked that the theory of functional products bears 
the same relationship to the theory of numerical products as the 
theory of functional series to that of numerical series. Let us give 
an example of a functional product. 

EXAMPLE 23. The product 


x uf I —~ [ere 


represents sin x for any x. 


8. Double series. Fundamental concepts and definitions 


In addition to ordinary (simple) infinite series, multiple series are 
employed in analysis and applied mathematics, e.g. double, triple, 
etc., series. We shall confine ourselves here to a brief outline of the 
theory of double series. 
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DEFINITION. A double series is defined by the symbol 


oa 


yd (or Dy ex) (3.61) 
k=0 l=0 k, t==0 

and is made up of the terms of the double sequence {a,,} (k = 0, 1, 
2, 3, ...; /=0, 1, 2, 3, ...); corresponding to it, we have a double 
sequence {s,,,,} of partial sums 


kem—l, i=n—] 
Smn = Y ap}. (3.62) 
k, T=0 
If a finite limit exists on simultaneous and independent increase 


of the indices m and n, 


S= lim Smn= >) a, (3.63) 
N—> co k, l=0 
M—> co 


the limit is called the sum of the double series (3.61), and the series is 
said to be convergent in this case; otherwise it is divergent. 

If the terms a,, are summed consecutively, first over one index, 
then over the other, the double sum will be described as an iterated 
series. Obviously, the following two cases are possible here: 


5 (5,0) (3.64) 


x (= ox). (3.65) 


Iterated series (3.64) is said to be convergent if the series 


A; = y ap, (3.66) 


k=0 


(for any fixed subscript /) and 


A, (3.67) 


are convergent. 
Similarly, series (3.65) is said to be convergent if the series 


B, = 2 Ap (3.68) 
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(with any fixed subscript k) and 


+ By (3.69) 


are convergent. 
Let us introduce the notation 


A= lim ( lim Sin] (3.70) 
R—> co \N-—-> co 
Similarly, 
B= lim Gey Smn) (3.71) 
m—-reo \n=> co 


A series for which all the a,, = 0 is called a double series with 
positive terms. 


If the double series } a,, and } |a,,| are simultaneously 
k, [=o h, lmao 
convergent, the double series is said to be absolutely convergent. 


Whereas if } a,, is convergent, but }° |a,,| is divergent, the 
k, l=0 k, l=0 


double series )' a,, is non-absolutely (or conditionally) conver- 
k, leo 
gent. 


9. Some properties of double series 


I. If double series (3.61) and series (3.66), (3.67) are convergent, the 
iterated series (3.64) is also convergent and has the same as the double 
series. 

Similarly, the following property holds: 

II. If double series (3.61) and series (3.68), (3.69) are convergent, 
iterated series (3.65) is also convergent, and has the same sum as the 
double series. 

REMARK. Generally speaking, the convergence of series (3.66) and 
(3.68) does not follow from the convergence of double series (3.61) 

Ill. The necessary and sufficient condition for the convergence of 
the double series (3.61) with positive terms is that its partial sums be 
bounded. 

IV. If one of the three series (3.61), (3.64) and (3.65) with positive 
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terms is convergent, the other two are convergent and have the same 
sum. 

A one-to-one correspondence can be established between pairs 
of equal terms of the double sequence {a,,} and the ordinary sequence 
{b,}. We shall say for brevity in this case that the double series 


)° a, and the series )° b, consist of the same terms. 
k, l= s=a0 


V. If the double series )' a,, and the series )\ b, consist of 
k, l=o s=0 


the same terms, the convergence of one implies the convergence of the 
other, and they have the same sum. 
VI. If the double series >’ |a,,| is convergent, the series ) a,, 
k, l=0 k, [=w0 
is convergent (but the converse does not hold). 


VII. If the double series a, and the series }' 6, consist 
k, l=0 s=0 


of the same terms, the absolute convergence of one implies the absolute 
convergence of the other. Both series now have the same sum. 

VIII. The terms of an absolutely convergent series can be rearranged 
in any manner without changing the sum. 

The above properties can be useful in proving the convergence, 
and computing the sum of a double series. 

EXAMPLE 24. It is easily shown that the double series 


ea 1 
no FTF oe 


is convergent for «> 2 and divergent for a = 2. 
For, on putting k+/ = m, we find that m—1 terms of series (3.72) 
are equal to 1/m*. Series (3.72) can therefore be written as the simple 


series 
co hm—] eo ] | 
—_—— = —_— — —., 3.73 
2 2 me~1 Ze me ( ) 


Both the series on the right-hand side of (3.73) are convergent for 
a> 2 (Example 15), so that the series on the left-hand side is conver- 
gent. By Property V of double series, the double series (3.72) is also 
convergent, and its sum is equal to the sum of the simple series (3.73). 
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10. Some convergence tests for double series of positive terms. 
Estimates of remainder term 


A necessary condition for the convergence of any double series 


y; ap, is that 
h, [0 
lim ay = 0, (3.74) 


when k and | tend to infinity independently of each other. 
A stricter necessary condition than (3.74) can be given for the con- 
vergence of double series with positive terms. 
For a double series with positive terms to be convergent, it is necessary 
that 
lim } a, =0 (3.75) 
k— co [=O 
and 
lim ) an, = 0, (3.76) 


l—> oo k=O 


so that all the more, the following conditions must be satisfied: 


Rk 
lim ¥ dy = 0 (3.77) 
k—oco |l=0 
and 
l 
lim y; api = 0. (3.78) 
[— co khwQ 


From (3.77) and (3.78), we see that the following conditions must 
also be satisfied: 


lim a@,,=0 for any J, (3.79) 


kR—> oo 
lim a,,=0 for any k. 
l—> oo 
As in the case of ordinary series with positive terms (see § 1, sec. 
3~5), comparison of the terms of two series leads to a number of gene- 
ral tests for the convergence of double series with positive terms, and 
corresponding remainder term estimates can be given. 
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Suppose we have the double series 
yn (3.80) 
T=0 
with positive terms, and some other series 
> Dp. (3.81) 
k, T=0 


We assume that the convergence or the sum of the series (3.81) is 
known to us in advance. We introduce the notation: k+/ =n, 


lim nt = A, (3.82) 
qosoo Chl: ~~ S 
—~ bh — 
lim — = 4. (3.83) 
n—> co Bp 
In the case when A = A, we have 
. Op 
lim —= 4. (3.84) 
n—> co Gp} 
The remainder term of double series (3.80) will be defined by 
Rinm = 'motlom t+lmm (3.85) 
where 
kmoo, l= m—1 k=m—1, | moo 
"no = Ary Tom = ar} 
kam, l= k=6, =m 
and 
'mm >= 3 Qpi- 
k, l=m 


We shail write B,,, for expression (3.85), corresponding to the 
remainder term of series (3.81). 

Using the above notation, the following general sufficiency tests 
can be stated for the convergence of the double series (3.80): 

1°. If0 = Byyy< + efor allm> N and A> 0, the series is convergent. 

2°. If-—-« <B,,, = 0 for allm=> N and A <0, the series is converg- 
ent. 

3°. If, with finite A and A. of thesame sign, Bm = + ©, the series 
is divergent. 7 
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4. If 0<B,,< +e for all m>WN, and the conditions 
—-o<A< +oandA = + ~are satisfied, the series is convergent. 

5°. If ~ 0 < B,, <0 for m> N and the conditions — oo < A<0 
and A = — ~are satisfied, the series is convergent. 

When series (3.80) is convergent, the following estimates hold 
for the remainder term: 


Binm = = Binm 
——_—_— fo , (3.86) 
b,, = = b 
. kl = = Rl 
inf — sup — 
k+iz=m GR h+l=m Qa 


When A= + cor A= —o(for A= + oo), 


(3.87) 


Further, on choosing the 5,, by different methods, we can obtain 
from the above general convergence tests various practical tests which 
are sufficient for the convergence of a double series with positive 
terms. Inequalities (3.86) and (3.87) enable us to give remainder term 
estimates corresponding to the convergence test chosen. 

We shall confine ourselves here to oneconcrete case, e.g. by putting 


by, = Qk +1, 141 — Fr+1, 1 — TC, 141 + Fae (3.88) 


It now follows from the above general tests that the double series 


); a, is convergent if: 


k, l=0 
(1) lim ay, = 0; (3.89) 
p—> ce 
; byt 
(2) A= lim —+0; (3.90) 
a k+l >oo kl 
and is divergent if: 
A= lim Ont 0. (3.91) 
k+i— oo Ap} 


The remainder term estimate corresponding to this test has the 
form 
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Amo + 2om— 2mm Amy + Agm — Imm 
ana ee — | ee eo (3.92) 
sup —2! inf —# 
k+l2=m Gp ktl=m Gr 


where 6,, is given by equation (3.88). 

Fulfilment of condition (3.90) only is not sufficient for convergence 
of the double series. 

EXAMPLE 25, The series 


“LOO: 


is obviously seen to be divergent; at the same time, the condition 
A = 0:1>0 is satisfied although lim a 


P—> ce 


= © 
pp ‘ 


EXAMPLE 26. Let us take the double series 
ee 1 


5 ke GFDIGED! 3.93) 
Condition (3.89) is satisfied here, since 
Ge ee fe Die: 
pro preo[(p+1)!P 
We have by (3.90): 
tim Pa jim Skt a ta Sho TE On 
htl-»eo ki h+1-> 00 Ap 
a for fixed /; 
= to) a Sa for fixed k; 


= | pe a a 
nti> oo (K+2)042) ) k+2 
l, if simultaneously 
k and J+, 
But obviously, — = (7+1)/7+2)=3 1 and >* (k+1)/(kK+2) = 1, 
le. A = >? for all k, | = 0. Series (3.93) is thus convergent. 


To estimate R,,,, in accordance with (3.92), we first observe that, 
for the function F(x, y) = (x+1) (y+1)/(x+2) (y+2), necessary 
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conditions for an extremum: OF/0x = OF/dy = 0, are not satisfied 
for any finite positive x and y, i.e. the greatest and least values 
of the function can only be attained on the boundary of the domain 
MBX, Y< -, 
Jt may easily be shown by using this fact that 
by tis (A+1)(7+1)  m+1 1 


inf —= = pee 
r+lz=m4p rtl=m(kK+2)(1+2) m+2 2 


ES 


and 
: (K+1)0+1) _ 
neizm(k+2)(14+2) 0 


On substituting the values obtained in inequality (3.92), we get 


2s a d(m+2) 2(m + 2) 
(m+1)! (m+)? OO (n+l) (m4 1)! ntl) (m+ DIP 


For instance, we obtain with m = 4: 
0-0159 S Rinm = 90-0382. 


§ 2. Series of functions 


1. Fundamental properties and convergence tests 


We shall discuss functional series in this article, i.e. series whose 
terms are functions. We shall confine ourselves simplicity to the series 


w(x) +X) +... tig(X+... = bs utx), (3.94) 


the terms of which are functions of a single variable. Immediate 
generalization is possible to the case of two or more variables. 
DEFINITION. The expression (3.94) is called a functional series; 
it is formed from the terms of the function sequence {u,(x)}, defined 
on the set X = {x} of the numerical axis E,, and has a corresponding 


sequence {s,}: 
nr 


5, = p? u,(x) 


=) 


of partial sums. 
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There are different types of convergence for the function s,(x): 
uniform, non-uniform, in the mean, etc. Corresponding to these we 
have different forms of convergence of the functional series. 

Let the sequence {s,(x)} be uniformly (non-uniformly) convergent 
on X to the function S(x). Series (3.94) is then said to be uniformly 
(non-uniformly) convergent, and S(x) is its sum: 


S(x) = 2, U(x). (3.95) 
um 
A Condition for Uniform Convergence of a Series: The necessary 
and sufficient condition. for series (3-94) to be uniformly convergent 
on X is that, given any e> 0, there exists an N independent of x such 
that, given any n>N and any m = |, 2, 3,..., the inequulity 


_ u,(x) 


ken+1 


<€ 


holds for all x € X. 
If all the terms of series (3.94), uniformly convergent on the set X, 
are multiplied by the same function v(x), bounded on X, 


| »(x)| = M, 


the uniform convergence is preserved. 

Tests for uniform convergence of Series. 

1°. WEIERSTRASS’S TEST. If the terms of series (3.94) satisfy on the 
set X the inequalities 


| u(x) | S Cy (n = 1, 2, 3, ...), (3.96) 


where c, are the terms of a convergent numerical series, (3.94) is uni- 
formly convergent on X. 
When (3.96) holds, the series 
d, Cn 
n=] 
is described as majorant for series (3.94). A functional series satisfying 
Weierstrass’s test 1s absolutely convergent, and moreover, the series 


>, | Mn(x) |. 


n=1 
is uniformly convergent. 
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Cases are possible when series (3.94) is uniformly but not absolutely 
convergent. 
The following tests hold for functional series of the form 


a a,,(x)b,(x) = a,(x)b\(x) +... +a,(x)b,(x)+ .... (3.97) 
2°. ABEL’S TEST. Series (3.97) is uniformly convergent on a set X 
if the series 


pa by(x) = 5i(x)+5,(x)+... (3.98) 


is uniformly convergent on the set X, while the functions a,(x) form 
a monotonic sequence for any x, and are bounded for any x and n: 


|a,(x)| = K. 


3°. DIRICHLET’s TEST. Series (3.97) is uniformly convergent on 
the set X if the partial sums s,(x) of series (3.98) are bounded for 
all x and n: 
Isp(x)| = M, 


while the functions a,(x) form, for any x, @ monotonic sequence, uni- 
formly convergent to zero on the set X. 

Let us also note some properties of the sum of a functional series. 
If the functions u,(x) of series (3.94) are defined in the interval 
X = (a, 5) and are all continuous at the point x = x, of this interval, 
and in addition, series (3.94) is uniformly convergent, the sum S(x) 
of the series is also continuous at. the point x = Xp. 

The following proposition is a consequence of this: if the functions 
u(x) are continuous throughout the interval ¥ = (a, 5) and if the 
Series is uniformly convergent there, the sum S(x) of the series is 
continuous throughout the interval. The uniform convergence in 
these propositions is a sufficient but not a necessary condition, since 
there are series, non-uniformly convergent in an interval, having a 
sum continuous in the interval. We shall not state here necessary 
and sufficient conditions for continuity of the sum of a series, and 
shall only mention that uniform convergence is necessary and suffi- 
icent provided the terms of the series are in addition positive in the 
interval. 
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Term by term integration of series. If the terms u,(x) of series 
(3.94) are continuous in the interval X¥ = (a, b) and the series is 
uniformly convergent in this interval, the integral of the sum S(x) of 
the series is equal to the sum of the integrals of the terms: 


[. S(x)dx = > : U,,(x) dx. (3.99) 
a nel Ja 

In other words, term by term integration of the series is permissible 
under these conditions. 

The following is a generalization of the above theorem: if the 
terms u,(x) of the series are integrable (in Riemann’s sense) in the 
interval X = (a, b) while the series is uniformly convergent, the sum 
S(x) of the series will also be integrable and (3.99) will hold. 

Term by term differentiation of series. If the terms u,(x) of series 
(3.84) are defined in an interval X = (a, 5b) and have continuous 
derivatives u(x) in X, and series (3.94) is convergent in X, while 
in addition the series formed from the derivatives 


ps U(X) = 'uy(x) + u(x) +... tua(x)t+ ..., 


is uniformly convergent, the sum S(x) of series (3.94) has a derivative 
in X, and 

S'(x) =F u(x) (3.100) 

Re 

in other words, the derivative of the sum ts equal to the sum of the 
series formed from the derivatives, 1.e. term by term differentiation 
of series (3.94) is permissible. It may be mentioned that the restric- 
tions of this theorem can be somewhat relaxed (see ref. 11, vol. II, 


§ 407). 


2. Power series 


This branch of the theory of functional series ts particularly import- 
ant. 
A series of the form 


YY) ag(X—X pq)” = Ag Fal xX— Xo) +... HA (x—X)*+... (3.101) 


n= 
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is called a power series. On substituting x; = x—xX, (we shall omit 
the subscript 1), it reduces to the form 


Y AnX™ = Apt ayx+agx7?+ ... ta,x™+..., (3.102) 
n=0 
with which we shall be concerned in what follows. 

There are three possible cases. 

Case 1. Series (3.102) is convergent for any real x, i.e. throughout 
the axis £,. In this case the series is said to be convergent everywhere. 

Case 2. Series (3.102) is convergent only for x = 0. The series is 
now said to be divergent everywhere. 

Case 3. The series is convergent in some interval (—R, +), 
0<R< +o; the number R is called the radius of convergence of 
the series. 

We shall accept the convention that Case 1 corresponds to a radius 
of convergence R = o, and Case 2 to a radius of convergence R = 0. 

EXAMPLE 27. The series 


is convergent for any x (R= -). 
EXAMPLE 28. The series 


Yo nix = x+2tx243!x34 ... 


n=1 
is convergent only for x = 0(R = 0). 


EXAMPLE 29. The series 


y x™ = L+xtxt+... 


n=l 
is convergent in the interval (-1, +1) (R= 1). 


EXAMPLE 30. The series 


ae x 
bee a has 


is convergent in the semi-interval (—1, +1) (R = 1). 
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EXAMPLE 31. The series 


eee aire ae 
wn 4 9 °"* 


is convergent in the segment [—1, +1] (R = 1). 
If the limit 


exists, (see d’Alembert’s convergence test) then 


R=—. (3.103) 


(R= eo forg=0, R= 0 for 90 = o), 


On starting from Cauchy’s test, we get 


1 1 
e lim*/la,| 


If series (3.102) has a radius of convergence R > O, no matter what 
the positive number r< R, series (3.102) 1s convergent uniformly 
with respect to x in the segment [—,, r]. 

The sum S(x) of series (3.102) is a continuous function of x for 
all x between — R and R. 

THEOREM 7 (on the identity of power series). If two power Series 


(3.104) 


y a,x" and x b,x" 


n=Q n=mod 


have the same sum in the neighbourhood of the point x = 0, the series 
are identical, i.e. their corresponding coefficients are equal: a, = b,. 

The following propositions concern the behaviour of a power series 
at the ends of the interval of convergence. If power series (3.102) 
is divergent at an end of the interval of convergence, the convergence 
cannot be uniform in the semi-interval (0, R). 
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The converse is: if the power series (3.102) is convergent for x=R 
(x =— R) (even non-absolutely,) the series is uniformly convergent 
throughout the segment {0, R] ( [—R, 0]). 

THEOREM 8 (Abel). Jf series (3.102) is convergent for x = R, its 
sum remains continuous (from the left) for this value of x, i.e. 

lim S(x) = S(R). 
x—>R—-0 

See Example 30 forx = —R = —1and Example31i forx = —R= 
=— L. x=R=1. 


3. Operations on power series. Taylor series. Integration and 
differentiation of power series 


(a) Power series (3.102) can be integrated term by term in the 
segment [0, x], where |x| < R: 


x oo x oo xnrl 
S(x)dx = Y | ayx"dx = Y a,—— ; (3.105) 
0 n=0 Jo n=o n+l 
x may reach the end of the segment at which series (3.102) is con- 
vergent. 

(b) Power series (3.102 ) can be differentiated term by term as many 
times as desired inside its segment of convergence: 


S'(x) = z na,x"—1, 
hw 


S"(x) = y n(n — 1)a,x"-?, 


S™x) = Y n(n—1)...(2—m+ l)ayx™-™; 
n=m 
this also holds for an end point of the segment at which the series is 
convergent. 

Taylor series. Different forms of the remainder term. A function 
expressible as a power series in its interval of convergence has deriv- 
atives of all orders inside the interval. The series itself is the Taylor 
series of the function. 
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If the function is expanded as a Taylor series in the neighbourhood 
of the point Xp, 


fa) = ¥ anlx— x)" (3.106) 


In this neighbourhood, where 


(n) 
.= ae (0! = 1). (3.107) 
The particular case of a Taylor series when x, = 0 is sometimes 
called a Maclaurin series. As follows from (3.106) and (3.107), it has 
the form 


f(x) = 7 A,X", (3.108) 
where 
(nO 
a 


On confining ourselves to a finite number of terms in a Taylor 
series, a function f(x) can be written as a partial sum s,, of the series 
plus a remainder term r,: 


2) = FY alx—xdk+ Yo ag(x—Xo) = sp(x)+7q(x). (3.109) 
h=0 ken+1 


When x + Xo, the remainder term r,(x) is an infinitesimal of order 
higher than n (compared with x—x,). There are various familiar 
forms of the remainder term of a Taylor series. 

The form of Schlomilch and Roche: 


fOFV xq + (x — Xo)] 
n! p 
Here p>0, O< 6<1 
On assigning concrete values to », we get more specialized forms 


of the remainder term: 
Lagrange’s form (p = n+1): 


r,(x) = (1 — 8)" +12~- P(x — xo)" *1, (3.110) 


r(x) = Biot ARO (a yet (0<6<1). (3.111) 
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Cauchy’s form (p = 1): 


f™* xq + (x — Xo)] 


r(x) = nl (1—O)" (x—xp)"** (0< 6 < I). 


(3.112) 


In spite of the indeterminate size of 0, these forms of the remainder 
term enable us to estimate the accuracy of replacing f(x) by the nth 
degree polynomial s(x). If the (m+ 1)th derivative is bounded in 
absolute value in the interval between x and x, by the number M, 
we have from (3.111): 


M\x—x,|"*} 
(n+ 1)! 
EXAMPLE 32. The Taylor expansion of the function f(x) = e* in 
the neighbourhood of the point x, = 0 is 


lr,(x)| = 


x x x" 
esx l+stayt cee +a7 tTalX)s 
where 
xrtl xnr2 


r(x) = Gath! '@aait Res 


By (3.111): 


a em n+1 
r(x) = (n+l)! ~ ° 
Here (when x>0): 
xn 
[r,(x)| < © Gap: 


For instance, when x = 1: 


[rp(1)| < poate 


The remainder term can also be expressed in the integral form, 
which contains no indeterminate numbers: 


r,(x) = | f (n+2)(7) (x — t)” dt. (3.113) 
" JX 
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We can write, in the above example: 
j x 
r(x) = 7 | el(x— ty” at, 
n e 0 


Notice that a Taylor series may be convergent, and not represent 
its generating function f(x). 

EXAMPLE 33 (Cauchy). Let g(x) be a given function, expressible 
in the neighbourhood of x = 0 by the series 


ioe (0) +2 x +E att see (3.114) 


We add to it the function »(x) = e~!/*. If we complete the 
definition of p(x) by putting »(0) = 0, both p(0) and all its derivatives 
y™ (0) vanish, so that the Taylor expansion of (x) in the neigh- 
bourhood of x = 0 is identically zero. But now: 


fe) = 9) +O) = 90+ TO x4 ZO ee. LIS 


It is clear from this that equality of the expansions of the functions 
(3.114) and (3.115) does not allow us to deduce the equality of the 
left-hand sides: f(x) ¥ (x). 

In general, if two functions f(x) and (x) are equal at x = x, 
and all their derivatives are equal, while at the same time the functions 
are not identically equal, their Taylor expansions are nevertheless 
the same in the neighbourhood of x = Xp. 

Various operations on power series. Substitution of a series into a 
series. Suppose we have the series 


z=fQ) = atayt+ayrt...= F any’, (3.116) 


n=0 


convergent in the interval (—R, R). The variable y is expressible in 
turn as a power series in x: 


y = O(xX)=b +b, x+ r+ ...= » Das (3.117) 
n=0 


convergent in the interval (—r, r). Say we want to express z as a 
power series in x and to find the interval of convergence of the series. 
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On formally substituting series (3.117) into series (3.116), we get 


z= ¥ Agx", (3.118) 
nr=0 
where 
Ag = Agtaybyp+anbe+..., 
Ay = 4b, + 2ayb 9b, + 3a3b2b, + ..., 
A, = 


Oye + do(b3 + 2byby) + 2a5(byb? + 52d.) + ... 


The question of the convergence of series (3.118) is answered by 
THEOREM 9. 1°. Jf 
| by | > R, 


series (3.118) is divergent, whereas, if 
| by | = R, 
the series is convergent in the interval (— R,, R,), where 


R, = (R—|ol|)o 


= __ 3.119 
M+R—|bo|’ ( ) 


o being an arbitrary positive number that satisfies the condition 0 <r 
and can be taken as close as desired to r, while M is the least upper 
bound of thenumbers |b,,|o™ (m = 1, 2, 3, ...), so that |b,,| 0" = M 
or all m. 

2°. If by = 0, series (3.118) will be convergent in an interval (—R,, 
R,), where 

Ro 
Ry = MarR’ 

3°. If the series z = )\ a,y" is convergent for all y, i.e. in the interval 
(— o, + o), series (3.118) will be convergent for |x|< 7, i.e. in the 
interval (—r, r). 

Multiplication and division of power Series. 

THEOREM 10. The product of the series 


f(x) = Yo agx®™ and ox) = ¥ bax’, 
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convergent respectively in the intervals 
I,=(-R, R) and l=(—R, R), 
is given by the equation 


F(x) = f(x)(x) = Cp + eyx +¢,x7 + =< Cx 
where Cy = Aobo, Cy = Agbdi+a,b9, Co = Apdo +a ,b,;+a_by, etc., 
and is convergent in the smaller of the intervals I,, I. 
The quotient of the division of 1 by the power series 1 + 3 b,x": 
n=l 
1+ y box 


r= 


f(x) = 


convergent in an interval (—7, r), is given by the series 
fix) = 14 Ax Apet 0. = 14+ F Agx™ (3.120) 
n=l 


where A, = —b,, A, = b?—by, A; = —b3+2b,b,—b;, etc. 
THEOREM 11. Series (3.120) is convergent in the interval (— o0/ [M+ 1], 
o/{M+1]), where 0 < 0 < r and o can be taken as close as desired 
to r, while M is the least upper bound of the numbers |b,,|o™(m = 1, 
aa Peres) 
We can easily pass from this to the division of one power series by 
another: 


(x) _ %+ax + Apx* + _ neo 
Y(x) bg +b, x +.bgx? ro Sy byx™ 
We have ™ 
a = na +X + Ayx72 + ...) (1+ AyX + AQx? + ...), 
where 


1+ x A,,x” = —_— 
ens 14+—) b,x" 
bo T 
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is obtained as indicated above. The expansion 


Ax) Sa 


is now convergent in an interval determined by the above theorems. 


4. Complex series 


A numerical (or functional) complex series 


Se (3.121) 


n=l 


is one in which the terms are complex numbers (or functions): 
Cy = Ay +id,. (3,122) 


The convergence of complex series (3.121) to the sum S = 4+iB 
is equivalent to the convergence of two real series 


> ans (3.123) 
nal 
5 Ps (3.124) 
n=l 

to the sums A and B respectively. 


We have: 
THEOREM 12. If the positive series 


on oo 


Dy lenl= + Vak+e, (3.125) 
n=1 n=1 
composed of the moduli of the terms of series (3.121), is convergent, 
series (3.121) is also convergent. 

In this case series (3.121) is said to be absolutely convergent. D’Alem- 
bert’s and Cauchy’s tests retain their validity for complex series. 
The theorem on rearrangement of the terms of a series and the rule 
for term by term multiplication of series can be carried over of abso- 
lutely convergent complex series. All the theorems on absolutely 
convergent real series retain their validity for absolutely convergent 
complex series. 
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Functions of a complex variable. If, for every value of a complex 
variable z from a domain Z in the complex plane, there is a corres- 
ponding single value of another complex variable w=u- iv, w is called 
a complex function of z in the domain Z and we write 


w = f(z). (3.126) 


If the function f(z) is expressible by a Taylor series in the neighbour- 
hood of the point Zp, i.e. can be expanded as a convergent power 
series in powers of (z—Z,), it is called an analytic function of z at the 
point 2,. If f(z) is expressible as a power series in the neighbourhood 
of any point of the domain Z (open or closed), it is said to be an 
analytic function of z in the domain Z. Functions having this property 
are of the greatest interest in applied mathematics. 
The complex power series 


Y, €n(Z— Zo)” (3.127) 
R=O 
has a number of properties similar to those of real power series. 
We can consider in future, without loss of generality, the series 


De (3.128) 
n=O 

Since this series has a circle of convergence instead of an interval 
of convergence, the term radius of convergence acquires a strict mean- 
ing here. 

If the coefficients c,, of power series (3-127) are real numbers, the 
radius R of the circle of convergence coincides with the previous 
radius of convergence. 

The following proposition holds: if the series (3.128) 1s convergent 
at some point z, of the circumference |z|=R, then as the point z 
approaches the point z, from inside the circle along a radius, we have 


lim Y cyz™= YS cyzz. 
Z—> Zo n=0 n=0 
A complex power series can be differentiated term by term inside 
its circle of convergence. 
If a function is expanded, as a series in powers of z, the distance 
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from the origin (z = 0) to the nearest singulart point of the function 
is equal to the radius of convergence of the sum of the series. 


EXAMPLE 34. 


l oo 
ee eet | se 4__ +6 er — {\rs2n om — 1)%z2n. 
icz ]—224 z4~— 264 + (— 1)"22" + pik 1)"z 
(3.129) 
If we take the real axis z = x, the expansion 
|. 24 y4__ x6 
Ttx2 = | > tle oP, Slee? On a (3.130) 


has a radius of convergence R = 1, although the function 1/(1+x?) 
and its derivatives have no discontinuities on passing through the 
points +1. On returning to expansion (3.129) in the complex plane, 
we see that the function 1/(1+2z*) has discontinuities at the points 
+i. This is in fact the reason for the divergence of expansion (3.130) 
for |x|> 1. 

If we introduce the notation c, = a,+ib,, (a,, 6, are real numbers), 
|z| =r, arg z = 9, series (3.128) can be written in the form: 


oo oo : 
Y cn2? = Y (a, tibyrre”s = 
n=0 n=0 


= x r"(a, + ib,)(cos nO +i sin n6)= 


n=0 


= x r™(a,, cos nO — 6, sin n6) +i y r™(b,, cos nO + a, sin n6). 


n=O n=Q 
Further, we have, on writing a,r" = A,, —b,r" = B,: 


>» Cn2™ = Y (Aq cos 164+ 8B, sinn6)+i ¥ (—B,cosn6 + A, sinn6). 
n=0 n=0 


n=O 


The real and imaginary parts of the series are thus written as trigono- 
metric series. 


f A singular point is one in the neighbourhood of which a function is not 
expressible as a power series. 
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EXAMPLE 35. 
l — nr ° 
erage ed (r = |z| < 1); 
] ] 1—rcos@ 


l—z 1—(rcos6+irsin0) 1—2rcosé+r? 


r sin 6 a et ogee 
vl oreOae ee sin kO, 


from which it follows that 


1—rcos 6 = ob 
1—2rcos@+r? — ae oe 


r sin 6 = 2 
1—2rcosO+r? ae a 


5. Trigonometric Fourier series 


A function f(x) having a period 2xf (f{x)=f(x+2nn), n= £1, +2....) 
can be expressed, under certain restrictions to be described below, 
as an infinite trigonometric Fourier series 


I(x) ~ = +4 y (a, cos nx + b, sin nx). (3.131) 
Nel 


The Euler—Fourier formulae are used to find the coefficients of 
series (3.131): . 


Aa == fixycosnxdx (n= 0, 1,-2, .- »), 


— 


(3.132) 


! x 
by = jijsanee Wet 3-%..5: 
In order that the Fourier series (3.131) be convergent to the given 
function f(x), i.e. for its sum to be equal, at every point x, of the 
interval (0, 27), to the value f(x,) at this point, the function f(x) 
must satisfy certain conditions (see below, and Chapter IV, § 2, sec. 5). 


+ If the period of f(x) is equal to 2L, it can be transformed to the period 2x 
by bringing in the variable y=xx/L, so that all subsequent discussions retain 
their generality 
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THEOREM 13 (Localization theorem). The behaviour (i.e. converg- 
ence or divergence) of the Fourier series of the function f(x) at some 
point X, depends exclusively on the values taken by the function in the 
immediate vicinity of the point Xo. 

The sum Sy of the series (3.131) for f(x) at x, is determined as 
follows: 

(a) when f(x) is continuous at x», we have 


So = f(%o); 


(b) when f(x) has a discontinuity of the first kind at x, (so that 
the limits f(x)+0) and f(x,—0) exist), we have 


5 _ f(X% +9) +f(% — 9) 
Re ee 


We say that f(x) is smooth in the segment [a, b] if it has a conti- 
nuous derivative in this segment. 

A continuous function f(x) is described as piecewise smooth in 
the segment [a, b} if the segment can be split into a finite number 
of subsegments, on each of which f(x) is smooth. 

A discontinuous f(x) is described as piecewise smooth on the seg- 
ment [a, 5] if: (1) it has only points of discontinuity of the first kind 
(and only a finite number of these) on the segment, (2) on each of the 
subsegments [c, ] into which the original segment is split by the 
points of discontinuity, the continuous function 


f(a+0) for x=a, 
g(x) = ¢ f(x) for «<x < , 
(8-9) for x=8 
is piecewise smooth. 

A convergence test for Fourier series. The Fourier series of a piece- 
wise smooth (continuous or discontinuous) function f(x) of period 22 
is convergent for all values of xp, its sum being equal to Sj. 

If a piecewise smooth function f(x) is continuous everywhere, its 
Fourier series is absolutely and uniformly convergent. 

THEOREM 14. Let f(x) be an absolutely integrable function of period 
2x, continuous and possessing an absolutely integrable derivative in 
some segment [a, b] (the derivative may cease to exist at individual 
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points). The Fourier series is then uniformly convergent to f(x) in 
every segment [a+6, b—6} (6>0). 

This theorem holds, in particular, for an absolutely integrable 
K(x) of period 2x, continuous and piecewise smooth on the segment 


[a, 5}. 
EXAMPLE 36. The function f(x) = —In| 2 sin ~ x | , which becomes 


infinite for x =2kz (k = 0, +1, +2, ...), has period 2x. Its Fourier 
series iS 


cos 2x cos 3x 
pease ae eS, + 


—In 3 


ee © 
2 sin > = cOSx+ 


THE DIRICHLET—-JORDAN TEST. The Fourier series of a function 
(x) is convergent at X, to the sum S, if the function is of bounded 
variation in some segment [xy— 6, Xo+ 4]. 

A more specialized statement is: 

DIRICHLET’S Test. If f(x) of period 2x is piecewise monotonic 
on a segment [—z, 2] and has a finite number of discontinuities there, 
then its Fourier series is convergent to the sum f(x) at every point 


of continuity and to the sum Sy) = 5 [f(X%o+0)+f(xp—90)] at every 


point of discontinuity (see Chapter IV, § 2, sec. 5). 
Dini’s TEST. The Fourier series of a function f(x) is convergent at 
a point Xp» to the sum S, if, given some h> 0, the integral 


|. | p(t) | it 
t 


0 
exists, where 


P(t) = flixo tt) +f(%o—t)— 2Sp. 


The following is a particular case of Dini’s test: 

LipscHITz’s Test. The Fourier series of a function f(x) is conver- 
gent at a point Xq which it is continuous to the sum Sy = f(Xo) if, 
given sufficiently small t> QO, 


If(xokt)—f(Xo)| S Lt, 


where L and @ are positive constants (« = 1). 
In particular, piecewise differentiable functions are suited to this 
test. 
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The Dini and Dirichlet-Jordan tests are not consequences of one 
another. 

In the case of a function f(x), only specified on the semi-interval 
(—z, x), or defined outside it but non-periodic, application of the 
above theory is made possible by replacing f(x) by an auxiliary func- 
tion f*(x), having the following properties: 


f*(x) = fl), (—7 <x 37), 
f*(—2) = f*@), 


while f*(x) is extended to the remaining real values of x in accordance 
with the law of periodicity. 

All the above theorems and propositions are applicable to the 
function f*(x). The series represents the function f(x) inside the inter- 
val, 

This construction is not required if f(—z) = f(x). In this case 
the Fourier series is convergent to f(x) throughout the open interval 
(excluding the ends). But outside the interval, the sum of the series 
in general no longer coincides with f(x), assuming the latter 1s defined 
throughout the real axis. 

On bearing in mind the footnote at the start of the present section, 
we can say that a function specified in any manner in any interval 
can be expanded as a trigonometric series in a very wide class of cases 
(this includes piecewise differentiable and piecewise monotonic 
functions) (see also Chapter IV, § 2, sec. 5). 

Expansions in sines only or cosines only. The Fourier series of an 
even function /(x)=(f(—x)) contains cosines only: 


f(x) ~ + y An COS NX. 
n=l 


The Fourier series of an odd function (f(x) = —/(—x)) contains 
sines only: 


T(x) ~ x 5, sin nx. 
n=l 


Every function f(x), specified in the segment [—z, 7], can be written 
as the sum of an even function f,(x) and an odd function /,(x): 


K(x) = fi) +f(>), 
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where the component functions are 


x) +f(-—x x)—f(-x 
60) FOE) poy POM), 
If a function is only specified in the segment [0, 7], we can define 
it arbitrarily in the interval [—z, 0] and thus obtain different Fourier 
series, which will have a sum Sp at a point x, between 0 and x, the sum 


being convergent either to f(xo) or to [f(o+0) +f(x9—0)} (in the 


case of a discontinuity). 

If we complete the definition of the function in (—z, Q) as an even 
function, i.e. put f(—x) = f(x), we get an expansion in cosines only; 
and if we complete it as an odd function (f(—x) = —/f(x)), we get 
aN expansion in sines only. 

EXAMPLE 37. f(x) =x(0O8 x32). 

(1) Let f(x) = f(—x) = —x(-—z5 x < 0); then 


cos 3x cos 5x 


xz 4 
T(x) = Fn (co gt os ). 


(2) Let f(x) = -—f(-—x) = x (—a < x < 0); then 
eur sin 3x _ ) 

The order of the Fourier coefficients. If a periodic function f(x) has 
a finite number of discontinuities of the first kind (in a period), 
its Fourier coefficients will be infinitesimals of the form O(1/n) as 
n-» oo (see Chapter 1, § 3, sec. 8 and 15). 

This means that 


nla,|< M, n|b,|< M, 


where M is a constant positive number independent of n. 

If the periodic function f(x) is continuous everywhere, its Fourier 
coefficients will be infinitesimals of higher order than 1/n asn + , 
i.e. of the form o(1/n) (see Chapter I, § 3, sec. 8 and 15). 

This means that 


lim na, = lim nb, = 0. 
N—> co N—> co 
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If a periodic continuous function has continuous derivatives every- 
where up to and including the (m— 1)th order, its Fourier coefficients 
a, and 6, will be of higher order than 1/n™ as n + ©, i.e. 

lim n™a, = lim n™b, = 0. 
nh—> oo l—> oo 

In particular, 1f a periodic function f(x) has continuous derivatives 
of any order everywhere, its Fourier coefficients a, and ), satisfy 
the condition 


n™a, +0, n™b, +0 


as nm —» oo, independently of m. 

Integration of Fourier series. Let us first consider a continuous 
function f(x), specified everywhere on £). 

THEOREM 15. Jf an absolutely integrable function f(x) is specified 
by its Fourier series: 


fx) ~ 2+ Y (Gq 008 nx+b, sin nx), (3.133) 
nal 


b 
we can find | S(x) dx by term by term integration of series (3.133), 
a 


independently of whether the latter is convergent or not, i.e. 


| “foo dx = B0-a)+ F 


a,,(sin nb— sin na)— 6,(cos nb—cos na) 
= : 
(3.134) 


THEOREM 16. Let an absolutely integrable function be specified 
by its Fourier series (3.133) (convergent or not). The following 
Fourier expansion now holds for its integral: 


= = 5 = —b, cos nx +(a, +(—1)"*1a,) sin nx 
x ax = pes pi sessed reach 2D re | ES ES a nae | ase aeac as 
[ fla)ax = § 22 F : 


(-z<x<72). (3.135) 


A particular case of this theorem is when a) = 0 (the other condi- 
tions are retained); we now have for all x: 


(3.136) 


sd ob co 6— 5, CoS mx +a, sin nx 
x)dx = — ; ee 
[soar = Fs s 


n=] n 
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Differentiation of Fourier series. 


THEOREM 17, Let f(x) be a continuous function of period 2x, possess- 
ing an absolutely integrable derivative (which may not exist at a finite 
number of points). The Fourier series for f'(x) can now be obtained 
from the Fourier series (3.133) for f(x) by term by term differentiation: 


oo 


f'(x) ~ ¥ n(b, cos nx —a,, sin nx). (3.137) 
n=l 
THEOREM 18. Let f(x) be a continuous function of period 2n, possess- 
ing m derivatives, the first m—1 derivatives being continuous, and 
the m-th absolutely integrable (the m-th m-ay cease to exist at a finite 
number of points). Now: (1) The Fourier series of all m derivatives 
can be obtained by term by term differentiation of the Fourier series 
for f(x), all these series, except possibly the last, being convergent 
to the corresponding derivative; (2) the following relationships hold 
for the Fourier coefficients of f(x) (see above): 
lim n™a, = lim n™b, = 0. (3.138) 
l—> oo N—> oo 
The series for f(x) and all the series obtained from it by term by 
term differentiation (except possibly the last) are uniformly convergent 
in this case. . 
This theorem has the following converse. 
THEOREM 19. Given the trigonometric series 


= 4. y (a,, cos nx +6, sin nx), (3.139) 
— n=] 


if the following relationships hold for the coefficients a, and b,, 
[n™a,|= M, |n™b,,| = M(m = 2, M = const), 


then the sum of the series is a continuous function of period 2x, pos- 
sessing m — 2 continuous derivatives, which may be obtained by term 
by term differentiation. 

THEOREM 20. Let f(x) be a continuous function specified on the 
segment [— 2, 2] and having an absolutely integrable derivative (which 
may cease,to exist at a finite number of points). Then 


f'(~) ~ - + yi [(nb, +(—1)"e) cos nx—na, sin nx], (3.140) 
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where a, and b,, are the Fourier coefficients of f(x), while the constant 
c is given by the equation 


¢ = = (fin) —f(—a)] 3.141) 
THEOREM 21. Given the Series 
~ + Da (a, cos nx +5,, sin nx), (3.142) 
if the series 
+ ” [((nb, +(— 1)"c) cos nx —na,, sin nx}, (3.143) 


where 
c= lim ((—1)"*' nb,]), (3.144) 


N—> co 


is the Fourier series of an absolutely integrable function 9(x)t, 


x 
then the series (3.142) is the Fourier series of f(x) -| p(x) dx + 
0 


1 = . 
+> 40+ a, continuous for —m%<x-< 2, and is convergent 
n=1 


to this function, while obviously f'(x) = v(x) at all the points of 
continuity of ¢(x). 
THEOREM 22. Given the series 


24 (= DP (aq cos nx-+ by sin m2), or) 
n=1 


where a, and b,, are positive, if na,, nb, do not increase (as froma 
certain n) and tend to zero as n-~ o, the series is convergent for 
—m < x <7 and has a differentiable sum f(x), where 


f'®) = Ps (—1)"n(b,, cos nx— a, sin nx), 


i.e. series (3.145) can be differentiated term by term. 

Similar theorems can be stated for functions specified on the seg- 
ment [0, 2] (see for example ref. 10). 

Further information on trigonometric series will be found in 
Chapter IV. 


t We do not assume the convergence of series (3.143). 
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6. Asymptotic series 


If a function F(x), defined for x = Xp, is to be considered for large 
values of the argument x, it 1s sometimes useful to find a function 
S(x) of simple structure such that 


R(x) = F(x)-—S(x) + 0 as xX, 


In this case F(x) can be replaced by S(x) for large x. If F(x) admits 
of the expansion (for x> x,): 


vA A, .A = A 
F(x) = AgtS+...4¢R+Ger te = Ly (3.146) 
we find, on putting 
n Ap Ay A 
Sx). = ee: = Ag+ +... +i (3.147) 
and 
R,(x) = F(x)-s,(x) = 3 Ar — Ansa 5 wee, (3.148) 
er xh xrt1 
that 


lim x"R,(x)=0, or &,(x)=0 (=) : (3.149) 
N—> co x 
i.e. R(x) is an infinitesimal of higher order than n. 

If F(x) does not admit of an expansion (3.146), it is still sometimes 
possible to choose a series of the form (3.146) such that condition 
(3.149) is satisfied for any fixed n. 

Series (3.147) is said to be asymptotic for F(x), and we write 

F(x) ~ pe : (3.150) 
Series (3.147) can be divergent, but it is still useful since it yields 
the approximate formulae 


A A 
F(x) = A ae share +H» 


the degree of the approximation being indicated by (3.149). 
EXAMPLE 38. Let us consider the function 


x 


F(x) = {_ ett ‘ 
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Repeated integration by parts gives: 


_1 1.2! ai ae 
FX) = ose tae ee H(-D (aa IE Ral )s 
where 
oo ext 
R,(x) = copa may at, 
x 
oo pt~t ex—t |txco co px—t l 
| pee = aa ~em4D | pre HS sae 
x tax ed 
consequently, 
|Ra(X) |< 5 


and condition (3.149) is satisfied. Thus 
= 
l 21 _1yr-1 piel wee 


eee ®@ 


This series is divergent, since 


—1)! 
lim @, = ae EAS yr Si 


li— co 


If F(x) admits of an asymptotic expansion, this latter is unique. 
The asymptotic expansion of the product of two functions F(x) 
and G(x), each of which has an asymptotic expansion 


F(x) ~ ¥ Agx7*®, Gx) ~ YS Byx7?, (3.151) 
h=0 k=0 
is formally equal to the product of asymptotic expansions (3.151): 
FO)G(x) ~ Yo Agee ® Yo Byxm® = Yo Cyxe®, (3.152) 
where 

m 
Cm = > AnBm—e: (3.153) 

k=0 


If the asymptotic expansion (3.150) of F(x) starts with the term 
Ayx~*, it can be formally integrated term by term in the interval 
from x to + ©, i.e. 


oo oo oo 4 co 
{. F(x) dx ~ 2s [. ax = »? , tea acest =. 
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Formal differentiation of asymptotic expansion is not permissible. 
If F(x) has an asymptotic expansion with no free term (A,= 0 and 
F(x) + 0 as x + ), this expansion can be exponentiated 
] 


al [F(x)}" ~ 


eFe) 145 
os 


nr 
wit Sby ee +|F4 ss +t lat wees (3.154) 

The asymptotic expansion is thus a source of approximate formulae 
for computing a function for large values of its argument, the acc- 
uracy of formula (3.147) being the greater, the greater the value of 
the argument. 

There exist functions, not identically zero, for which all the coeffi- 
cients A, in the asymptotic form (3.150) are equal to zero. Such 
functions are described as asymptotic zeros. An asymptotic zero is 
any function F(x), for which 


F(x) = O (=) 


for any n. For example, F(x) = e~* is an asymptotic zero. Addition 
of this function to the left-hand side of (3.150) does not change its 
right-hand side. 

Not every function F(x), defined in the semi-interval [a, + ], 
admits of an asymptotic expansion (3.150), but if such an expansion 
exists, it is unique for the given F(x) (the coefficients are uniquely 
defined). On the other hand, there exists for any sequence of numbers 
{A,} a function F(x), for which the A, are the coefficients of an 
asymptotic expansion (3.150). This F(x) is not uniquely defined, 
however (to an accuracy of an asymptotic zero). 


7. Some methods of generalized summation of divergent series 


Certain classes of divergent series, i.e. series lacking a sum in the 
ordinary sense of the word, are capable of generalized summation. 

The definition of generalized sum usually satisfies two condi- 
tions: 

1°. The linearity condition. If the generalized sum A corresponds 
to the series »y a,, and the generalized sum B to > b,, the series 
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)\(pa,+45,), where p and q are arbitrary constants, must have a 
generalized sum equal to pA4+qB. 

2°. The permanence condition. If a series is convergent in the 
ordinary sense to the sum 4A, it must also have a generalized sum, 
equal to A. 

The general plan for constructing linear permanent methods of 
summation is as follows. 

Let 

Yo(X), yi(x), soit eg Yn(X); ores (3.155) 


be a sequence of functions given in a domain X of variation of the 
parameter x, and let X have a point of condensation — the finite or 
improper number w. 

We construct, in accordance with the numerical series 


>» ans (3.156) 
n=O 
the functional series 
Yana (3.157) 
re 


If this series is convergent, at least for x sufficiently close to a, 
and its sum S(x) tends to a limit A as x ~ w, this number 4 is in 
fact taken as the generalized sum of series (3.156). To ensure that 
the method has permanence, two conditions are imposed on the 
functions y,(x): 

(1) lim y,(x) = 1 On 0y Te 2c ead): (3.158) 

x<-> @ 


(2) for all x EX: 
| Yo(x)| +y | Yn(x) — Yn-1(*) | S&S K < © (K = const). (3.159) 


We shall next consider two methods of generalized summation, 
embraced by the general plan just described. 

1°. The method of power series (Poisson). In accordance with the 
given numerical series (3.156), we form the power series 


YS) yx” = Ag tax... a,x" +2243 (3.160) 


n=a@ 
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if this series is convergent in the interval 0 < x < 1 anditssum S(x) 
has the limit A as x > 1: 


lim S(x) = 


nrn-> 1-0 


the number 4 is called the generalized sum (in Poisson’s sense) of 
the given series (3.156). | 
This method follows from the general scheme if we put 


=(0,1), m=1, y»,(x) =x" (n= 0, 1, 2, ...).. 
EXAMPLE 39. Let us take the series discussed by Euler: 
1—1+1—1+1-l1+.... (3.161) 
It has no sum in the ordinary sense, since s,, oscillates between 0 and 
+1. The corresponding power series (3.160) has the form 
L—~ xx? — x8 4 xt xh + = 7 (—1)"x". 


For 0< x < 1, itssum (asthe sum of an infinite geometrical pro- 
gression) is equal to 
l 


S(x) = 5 ee ae? (3.162) 
the generalized sum in Poisson’s sense of series (3.161) is 
A= lim sit = if (3.163) 
xi-ol+x 2 
EXAMPLE 40. The series 
y sin 78 (—x 36 s72) (3.164) 


nel 


is convergent only for 6=0 and 6 = +2. The corresponding 
power series 


x" sin nO (3.165) 


n=l 
has the sum, for 0O<x <1: 


x sin 6 


St) = 1—2xcos@+ x? ° 
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The generalized sum is thus equal to 


A= lim eine = ae = Deeseaae 
 eyq-o L—2xcos0+x® ~~ =2(1—cos 0) 2 2” 
(3.166) 


2°. The method of arithmetic means (Cesaro). We take the partial 
sums 5, of the given numerical series (3.156): 
So = %, 5, = An ty, 


n (3.167) 
Sg = Ap +Q,+ay,..., Sp= >) ap 


and form their consecutive arithmetic means: 


Sot St is SotS, +... +5nm1_ (3.168) 


A, = So, A, = 7 eee n 


If the sequence {4,} has a limit A as n - co, we call A the generalized 
sum (in Cesaro’s sense) of series (3.156). 
This method follows from the general plan if we put 


ee for m=0,1,...,n—I, 
X=no= +- 09, Vn(n) = Pa} 
| 0 for mn. 


EXAMPLE 41, Let us return to series (3.164). When » ~ 0: 


| l 
cos + 8—cos (* +5)? 


Sn = 


a | ’ 
2 sin = 9 
nA, = * cotans — Bt Da sine | 
4 sin’ ~ 6 


1 6 
A= lim A, = —cotan—. 
hi—=—> a ie 2 2 
We have thus obtained a generalized sum in Cesaro’s sense equal 
to the generalized sum in Poisson’s sense. 
The inter-relationship between the Cesaro and Poisson methods 
may be explained by quoting the following theorem: 
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THEOREM 23. (Frobenius). Jf a series is summahle in accordance 
with the method of arithmetic means to the finite “sum” A, it is simul- 
taneously summable by the method of power series, to the same sum A. 

Notice that Poisson’s method is applicable to a wider class of 
Series than Cesaro’s method, though it does not contradict Cesaro’s 
method when both are applicable. 


§ 3. Methods of calculating the sum of a serics 


We shall discuss in this section some methods of finite summation 
of series, some estimates for series, finite sums and products, and 
the problem, of importance for practical computation, of improving 
the convergence of series, i.e. methods enabling a given series to be 
replaced by another, having the same sum but more rapidly con- 
vergent. 


1. Elementary methods of exact summation 


It is very rarely possible to sum exactly an infinite series obtained 
as a result of solving some problem. Some simple methods of strict 
finite summation are given below. 


THEOREM 24. If the terms a, of the series ) a, can be written 


n=0 
in the form a, = b,—b,,, and if the b, form a sequence {b,} having 
a limit a, the sum of the series is 


S= Ya,=bh-a. (3.169) 


n=0 


EXAMPLE 42. Suppose we have the series 


= ] 
Py Jn(ntl)(Jn+ Jnl) ” 
j ] 1 


Jnnt Gintama l) dn sae’ 


and lim 1//n = 0, so that S = 1 (by = b, = 1). 


R—> oo 


here 
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THEOREM 25. If the terms of the series )\ a, are expressible as 
n=O 


din = Dn nr $&—Daagt o++ t&pOnep» (3.170) 


where p is some fixed positive integer = 2, b, form a sequence having 
a limit a, and «, are numbers satisfying the condition 


hy +e+... +2, = 0, (3.171) 
the series in question is convergent, and its sum is equal to 
S = ab, +(x, +ag)bot 2.0. HUM Het... Hhpup bp + 
+ (aq + 2% -+3a,+(p~1)ep)a. (3.172) 
EXAMPLE 43. Given the series 


= 4n+6 
nao (2 +1) (+2) (n+ 3) ’ 
we have 
4n +6 _ 1 2 3 
(n+ lait 2)(n+3) ntl 'nd2 n+3° 
Consequently, a, = 1, a, = 2, aj = —3. 


Condition (3-171) is satisfied : 1+2—3 =0. In addition, 5, = 
=1/n — 0 as n— oo, We now find, by (3.172): 


1 5 


THEOREM 26. If the terms of the series }, a, can be written as 
n=0 


a, = by, aa bsg 


where q is a positive integer, while the sequence of numbers bo, 63, 
bo, ... has a limit &, the sum of the series is 


SY dy = both t 5 bg 1-98. 
n= 


Tables of series expansions of functions and the relevant sections 
of reference works may be used for the finite summation of series. 
Given a particular series, it should be verified whether or not it 
is to be found in a reference book, or whether it can be transformed 
to a familiar series by a change of variable or some other means. 
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EXAMPLE 44, Suppose we have the series 
\) kp* sinkx, |p| <1. 
k=1 
We find in ref. 7, formula 1.447 3, which we can write as 


— ne 
¥ pk cos kx = + ae 


l 
ost S taapesa eC 


The uniform convergence of this series and the series of the deriva- 
tives of its terms with respect to x follows from comparing them with 


the majorant series } |p|* and } k|p|* respectively. On differen- 
k=l k=l 

tiating both sides of the equation with respect to x, we find the sum 

of the series (see § 2, sec. 1): 


— Ek: _ _ p(l— p*) sin x 
P» kp" sin kx = (i op eos xa 7) ({p| < 1). 


2. Summation of ‘series with the aid of functions of a complex 
variable 


If the trigonometric series 


a+ J) dy cos nx = f(x), (3.173) 
n=] 


y ay Sinnx = f(x) (3.174) 
n=1 


have positive coefficients a,, and the series }' a,/n is convergent, 
nel 
(3.173) and (3.174) are the Fourier series of continuous functions. 


We can sometimes find the functions f{(x) and f,(~) — the sums 
of series (3.173) and (3.174) — by making use of functions of a 
complex variable. 

Let 


9(z) = + y Op,z" 
nel 


be the sum ofa series convergent in the circle |z| < 1. If lim 9(z)= 
Jz|—>1 
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= lim o(re*) = o(e*), then fi(x)+if,(x) = y(e™), i.e. after separating 
the eal and imaginary parts of y(e™), we have: 
Fix) = Re {p(e*)}; (3.175) 
F(x) = Im {p(e*)}. (3.176) 


EXAMPLE 45. Let us establish the convergence and sum of the 
series 


cos x cos2x 2 cos mx 
l+s,-+-3 + aang So oe » oe (3.177) 

sinx sin2x ce sin nx 

TT ca) i +...= p> = (3.178) 


The convergence of series (3.117) and (3.178) follows readily from 
a comparison with the series 


which is majorant for the given series. Furthermore, we put 


n 
Sa Se 


pz) =1+ 


n=} 7 


On expressing z in the exponential form z = re** and letting r tend 
to 1, we have 
ef = ecosxtisinx — 9608 *7eo¢ (sin x) +i sin (sin x)] = 


e% (cos x+isin x)” 
nel nN: 


> 


cosnx . y sin mx 


e°8 * cos (sin x) + ie°** sin (sin x)= 1+ ) 
n=l 


n! n! 
Hence, 
1+ YO = 08% cos (sin x), (3.179) 
n=l : 
y a = e88* sin (sin x). (3.180) 
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3. Summation of series with the aid of Laplace transforms 


Definition of the Laplace transform. Suppose that, given any x>0, 
the modulus of the function (x) increases more slowly than some 
exponential function 1.e. there exist numbers M and So, not depending 
on x, such that, for any x, 


| p(x) | < Mesox, (3.181) 
Let p = s+io be a complex number. The integral 
a(p) = | ” e- P(x) dx (3.182) 
0 


now exists and has derivatives of all orders in the half-plane 
Re p > So. The integral (3.182) is called the Laplace transform of (x). 
In the accepted brief terminology, y(x) is the pre-image, and a(p) the 
image. 

Tables have been compiled for the pre-images and images of many 
functions (see for example ref. 7). 

Summation of numerical series (ref. 9). If, given the convergent 
infinite series 


S= ¥ (+)a(k) (3.183) 
h=1 
its terms are images of a pre-image (6), i.e. 


a(k) = | ~ emheg(e) de, 


0 


the following formula holds (preserving the correspondence of the 
+E signs): 


= = = @(E) dé 
2, (+ 1*a(k) = | of I" (3.184) 


EXAMPLE 46. Knowing that 


= ‘: e- sin at dé, 
0 


a 
k2 4 q? 


we have by (3.184): 


= l _ 1 ~sinaéd& x a4 
on ke + a | Ser ee = 3g cotanh xa—-;. 
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Generating functions. If the terms of the sequence {f,(t)} (kK = 1, 
2, 3, ...), defined in some interval «<t<f, are the coefficients or 
the Taylor expansion of a known function F(x, t) in powers of x fof 
|x| <1, Le. 

F(x, th= Y x*f,(0) (3.185) 

k= 
F(x,t) is called the generating function of the sequence {f,(t)}. For 
example, one of the following sequences can be taken as {/,(t)}: 

(a) the sequence of powers ft, f?, #5,..., where 


F(x, t) = — = b7 hth, (3.186) 


and |xt| <1; 
(b) the sequence of trigonometric functions 


sint, sin2f, sin3t,... 


or 
cos?t, cos2t, cos3f,... 
where 
= x sin t oe 
Fix, j= 1 ast x,» sin kt (3.187) 
and 
_ x cos t—x? a 
F(x, t) = T— 2x cost+x2 = Le cos kt. (3.188) 


where ¢ can vary in any interval and |x|< 1; 
(c) the sequence of Chebyshev polynomials T,(x), T,(x), T3(x),...; 
for which the following relationship holds: 


F(x, t) = eee = x x*T,(t). (3.189) 


where |¢| = 1,|x|< 1; 
(d) the sequence of Legendre polynomials P,(t), P(t), P3(t),..., 
where 


|p FP, (3.190) 


F(x, t) —— 
( a/ x? — 2xt +1 k= 


for |t| = 1 and |x| <1. 
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It should also be noticed that the infinite series (3.186)-(3.190) are 
convergent for x = + 1 or oscillate between finite limits (i.e. the 
sum of the first m terms remains less in absolute value than some 
constant independent of ¢ and m). 

The summation of functional series (ref. 9). Suppose that the 
generating function F(x, t) is known for an infinite sequence of 
functions {f,(t)} (k = 1, 2, 3,...) (see above). Let the series 


S(t, = ¥ alk)x* f(t) (3.191) 

k=1 
be convergent in some intervala < t< Band for |x| =1. If the coeffi- 
cients a(k) of series (3.191), considered as functions of the index 
k, are images of some 9(§), we have for the sum of series (3.191): 


S(t, x) = | ” o(&) Flxe~, 1) db, (3.192) 
0 


EXAMPLE 47. Knowing that the fraction 1/(k+/) is an image of 
e~*! for any /=0 and k => 0, i.e. 


l co 
_—_—_— = —(k+D€ 
k+l {. ° oo 


and using formulae (3.187), (3-188) and (3.192) for positive integral 
l, we have: 


co x sin kt 
S t, = ————_——_—_ = 
le = 2 
l cm — ])™-1 m 
= xt] y soo aoa Cr (—1)’x" sin (r-— Dt+ sin a _— 
me=l m r=. 
sin It x sin t 
= ) In (1 — 2xcost+x*)+cos lt sa, (eae ; (3.193) 
co xk cos kt 
So(t, x) = ——___—— = 
26 *) vy k+l 
= xt] yy ——— | y Ch(— 1)'x" cos (r—D)t— cos u|- 
m= mn r=0 
cos It x sint 
re In (1 —2x cos t+ x*)+ sin /t arctan ee » (3.194) 
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Formulae (3.193) and (3.194) remain valid for any ¢ and |x| =1, with 
the exception of points of discontinuity (ref. 11), which may make 
their appearance for the trigonometric series with x = +1. 

On making use of generating functions (3.186), (3.189), (3.190), as 
also (3.192) with positive integral /; summation formulae similar to 
3.193) and (3.194) can be established for the series 


= oe 7 (f) ec xkp,(t) 
’ ———— d 
2 k+l 2 k+l ie a> k+l 


4. Integral estimations for finite sums and infinite series 


Euler’s formula. If a function a(x) has derivatives up to and in- 
cluding the nth order for m= x Sk (mand k are positive integers), 
the following formula holds, due to Euler: 


k—-1 R n-1 B 
> a(t) = | a(t) dt + > at [a®-D(k) — a®—-Ym)] _ 
tm pay Y: 


m 
1 k-1 

a [0 Fa ™\e+1—z)dtt, (3.195) 
na: 0 tam 


where Y(t) = B(t)—B,, B, are Bernoulli numbers, B,(t) are 
Bernoulli polynomials (see Chapter VI). 


First integral estimate. We suppose that a\™ (x) = Ott in the interval 
g= x3 p+l (p andgare positive integers). Let 7, denote the greatest, 
and m,, the least, value of Y,(t) in the segmentQ == 1. The following 
inequality now holds: 


s(P +1, 9)— 2 fap 4-1) —a"-Q)] = Falk) 


=q 


S (P+, ——* [a™M(p-+1)—a"—N@)], (3.196) 


tNI—1l 
t+ When n=1 we have to assume y (B, /»!) [a%—9(k) ~a—Y(m)]=0; in 


vm) 
addition, it is assumed here and throughout what follows that fO(x)= (>> 
tt If a™(x) #0, the inequality signs of (3.196) have to be reversed. 
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wheret 


s(P+1, 9) = \" a(t) dt + De; [al M(p + 1) — a2), 
q 


Let us quote some values for M, and m,;: 


1 ad, maw, 


le al ee eal at amie 7s eT 


M,= 76° = 0; M, = 0-0244582..., m, ~ —0-0244582.... 


bod 


It can be shown that 


M,, = ¥a(5) > QO and m,=0, if I is even 


If we make the following assumptions: 
(a) a™x)20 for qux<~; 
(b) lim a™(x)=0 for m=0, 1, 2,..., 1; 


£—> co 
eo 


(c) the integral | a(x)dx is convergent, 
q 
we now get, by (3.196), as p + ©: 
M, 
Sy (+, 9) + —- pan” (q)= 


< ¥ ak) s5,(+%, eben (3.197) 


h=q 


where 
=1 B 
neue |" a(t) dt — "5 =* alr-0(4), 
g 


EXAMPLE 48. Knowing that the derivatives of any order of a(x) = 
=I1/¥v x are sign-definite in 1 = x = 101, we can estimate the sum 
Sa) = 
Ret Jk’ 
by making use of (3.196). 


+ When n=1, we have to assume — = fale—2) (p-+1)— —al¥~—1)(q)] =0. 


Pm] 
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We have, for instance, 
18-1< § < 19 ‘for n=1; 
18-55 < S < 18-61 for n=2; 
18-5890 < S < 18-5909 for n= 6. 


Second integral estimate. If we assume that (— 1)™~} a®@™ (x) = Of 
for ga x=ptl, the following inequality holds: 


B 
Som-i(p +1, q)+ Om)i [a2™—(p + 1) — a@™—1(q)] = 


= 2 a(k) = Sam—(P +1, q), (3.198) 


where 
p+ 
Som-1(P +1, 9) =| a(t) dt+ De, <r lap + 1) — a®—1)(q)). 
gq 


If we assume: 


(a) (—1)™-la2m)(y) = Ot for gqsex<+o 
(b) lim @@-D(x~) = 0 for =1,2,...,m™ 
x—> co 


’ (c) integral | a(x) dx is convergent, 
q 


the following holds: 


eS D- Gis, aq) = ¥ atk) = Sam—i(+ ©, 9)s 
kmq 


(3.199) 
where 


eo am—2 B 
Som + 9) = | a(t) dS" Se ale-04Q) 1, 
q is . 


EXAMPLE 49. Knowing that, with a(x) = x*/, the following 


condition holds: (—1)4 at (x) > 0 for all x > 0, we can carry out 
an estimate of the sum 
S =_ fc 3!2 
a 


Tt If (—1)"—'a@™(x) 3 0, the signs of inequalities (3.198) and (3.199) must 
be reversed. 


2m—2 
tt When m=1, we have to put »y (B,/va®—(g) = B,a(q). 


Val 
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by making use of inequality (3.198) with m = 2. We have 
40501-2260 < S < 40501-2265. 


The first and second integral estimates may be used not only 
for evaluating finite sums and infinite series, but also for evaluating 
finite and infinite products. 

EXAMPLE 50. Let us estimate the size of the product P = p!. 


p 
On taking logarithms, we have S = In P = )) Ink. 


ke} 
Notice that the following conditions are satisfied for the function 
a(x) = In x in the interval JS xsp+1s: 


a'(x) = <> 0, a(x)= nz <Q and a’(x)= 5 > 0. 


On using (3.196), say with n = 3, we get 


s(p+1, D-¥S[0"(P+1)- a") 3 InP 


=5,(p+1, I+ ~— v3 fa"'(p +1)—a’(1)], (3.200) 


s(ptl, I) = (>+z)Be+D-2| 1-Esp | 


On exponentiating inequality (3.200), we finally get 


_V3 (2+p)p V3 (2+p)p 
Le ™ P+ < pl x Lets (B+ 


where 


where 


-»[\+iprpl 


pot 
=(p+l) “e 
We next consider transformation of series for improving their 


convergence. 


5. Kummer’s transformation 


Suppose we have the series with positive terms: 


oo 


Rm = > G (3.201) 


nem 
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and some auxiliary series 
By =). De (3.202) 
n=m 


which is convergent and has a finite sum B,,. Suppose the finite limit 
exists: 


A= lm — <0. (3.203) 


In these circumstances series (3.201) is convergent (see Test III, § 1) 
and the following identity holds: 


B, 1 
Rn = 28+ F (1-3 =| an (3.204) 


which is known as Kummer’s transformation for the series (3.201)- 


6. Improvement of the convergence of series corresponding to a 
given convergence test 


Transformation (3.204) can be used for improving the conver- 
gence of series (3.201). For, by (3.204), the convergence of (3.201) 
will be improved in the sense that the general term a{!)= 


= (1-4 (10x) of the transformed series } a will tend 
n=mM 
to zero faster than a,, ie. lim a/a, = 0. Obviously, the faster 


l—> oo 


the ratio b,/a, tends to its finite limit A ~ 0, the faster the series 
on the right-hand side of (3.204) will converge. 

Transformation (3.204) can be applied several times in succession 
to the same series (3.201). 

Suppose, for example, that the terms of the auxiliary series 


BW = Fo (k= 0, 1, 2,..., 7) 


nrn=mMm 


are chosen successively so that 
(1) the sum B® (k = 1,2, ..., p) is already known to us; 


n 
ap 


all the A, being bounded and non-zero. 


pf) Alk) 
(2) A, = lim A‘), where A® = 2, giktl) = ( 1—-—* } a®), 
N—> co Ap, 
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Now, on putting A“ /A, = 1—e*), where lim e = 0, we have 


after the pth transformation of (3.201): ais 
Pp Bok) eo ? 
Ry, = ea el). 3.205 
" 2, Ap t aon - i ( ) 


_ It occasionally turns out that all the e® = 0 for a certain k, 
and we get the strict sum of series (3.201). 
Every transformation of type (3.204) is determined by the choice 


of some series )) b,,, which corresponds to some test which is sufficient 


nel oo 
for the convergence of the series }'a,, obtained from Test III. We can 
n=l 


say in this sense that, for every convergence test following from Test 
Ill, there is a corresponding method of improving the convergence 
of the series. It may prove convenient in practice to take all the 5°), 
69), b@), ... equal or different in transformations (3.205), i.e. 
to choose the stages in the improvement of the convergence in accord- 
ance with the convergence obtained by using different tests. We 
shall consider below, as an example of the application of transfor- 
mation (3.205), methods of improving the convergence of series 
corresponding to d’Alembert’s and Gauss’s tests. 

Improvement of the convergence of series corresponding to d’ Alembert’s 
test. We put in identity (3.204): b, = a,,,-—a, = 4a, and take 


the series 5° a, to be convergent by d’Alembert’s test, i.e 
n=1 


22 oe A 
Rm = Yo an = a y ( -2): (3.206) 


where 


On again applying transformation (3.206) to the series 


oo Aa 
y, a), where qi) = ey oe ; 
n=m 0 
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we have 


= ] A ee A a 
ice a oe een 
Ea = 7 (1-H) mt B(1-F) (1-3) 


The following notation is used here: 


1 1 Aa, A A 
= (ata) Amr ek= (1a)! 


A 
A li 2) l 4(1-4) 
= hm = Am —-—. 
TT pee AD ae 1-4 a 
Ay} " 


Thus, p successive applications of the above transformation to the 
original series give (using the above notation): 


= a Pal 1 A 
R,, = a, = Soy —j{1l- an + 
- Xn Ag P i rl rar | i 


Umm” SaxQ 
where 
k-1 A 
A, = lim —* and A, = lim => AN ; 
ti —> oo n Rt— co | eons 
TT ( 4) 


Euler’s transformation. Given the power series 
Yo tnx" (3.208) 
n=l 
Suppose that the following conditions are satisfied; 


k 
lim “2t1=1¢ and lim a = ] (3.209) 


n—oo Xp Nl—> co n 


CG De eee DP), 


+ This guarantees the convergence of series (3.208) with |x|~<1 (see ref. 
11, vol. IH). 
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We can now apply to series (3.208) the transformation (3.207), which 
reduces to the following familiar Euler transformation: 


pal k+1 
S. agx™ = SE 4S Ahan (3) . 


n=1 1-xX el 


+( res =) bs (APa,)x". (3.210) 


EXAMPLE 51. Let «, = P(n) be a polvieiial of degree m; it is 
easily verified that conditions (3.209) are satisfied here for all k = m, 
while we have in addition 4*x,, = 0 for any k > m. Now, on applying 
(3.210), we obtain, for |x| < 1: 


3 P(x = re ¥ 0 (735 > i 
n=ji 


Improvement of the convergence of series corresponding to Gauss’s 


test. Suppose that the series }' a, is convergent where the conditions 
nem 
of Gauss’s test are satisfied, i.e. 


Ang, _ h+pyn*-14 9(n) 
a,  +q,n1+ y(n) ’ 


where y(n) and (n) have orders lower than n*-}, and in addition, 
G1—P > 1 (see § 1, sec. 5). 
If we put b, = (n+1)a,,,—74,, transformation (3.204) can be 


applied to the series }) a,. We have 


Rem 


aoe 
a p——} (EE A aay ae + 
= . —P\-1 
ss i ae | oA—2 , 
] pn + Pon t+ 6. + Ds (3.211) 


a ag nam Mtg i+... +a om 


where p,, Po ---» P, are certain new coefficients not dependent 
on n. Transformation (3.204) for the series (3.211) can be repeated. 
EXAMPLE 52. If transformation (3.211) is applied twice to the 
series 
= j 
~ Py n(n + 1) 
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we get 
S= ane y er Sars 2 
30 aint 1) @+2)(2+3) 


If we take into account only three terms of the last series, we get 
S = 59/60, while the exact sum is S = }. 
EXAMPLE 53. Given the series 


S= Y a (3.212) 


where 


_ AGED B+H 
aU Gage tn ene ese 


we can apply transformation (3.211) several times. We obtain after 
p transformations of the series (3.212): 


~~ %B 
~ Ay—-a—B) = 


ap pal & (yp +-s—a) (y+s—8) 
Wy—a—B) po sao (VtS+)N (¥+s+1—a-—8) 


(y+s—a)(y+s—B) & Ay 
+i B+s—a—B n=m Il (n+y—5) ; 


Ss 


+ 


7. Abel’s transformation 


The identity 


nr n—1 
> &pBe = Bat Y er—Xpoi Br (3.213) 
k Km 


ml 


h 

where B, = > 8;, is called Abel’s transformation. It is the analogue 
i= 

of the formula for integration by parts of finite sums. On letting 

k + cin (3.213), we arrive at infinite sequences {x,} and {@,}. 

It follows from (3.213), provided {B,} is bounded and lim«, = 0, that 


kR—>» oo 


> tnP, = pa (Xp —%n 41) By, (3.214) 
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This transformation can be utilized for improving the convergence 


of infinite series (see ref. 1). 
EXAMPLE 54. Let us improve the convergence of the trigonometric 


series 


oo oo 
yu, sinkx and )}' u,coskx, where lim = 0, 
ke h=1 


with the knowledge that 


Rk ] x 
py sin ix= > cot a an = 
2 
and 
: l 
» . 1 sin (+4). 
» cos ix = -—-—+—-—_—""_—-. 
t=] 2 . x 
2 sin = 


On using transformation (3.214) after putting «, = u,, Ju, = 
= U,11—U,, We get: 


a Uy cot 1 a i 
>, u, sin kx = ——~———_ + > Au, cos{ k+— | x; 
kel 2 : hel 2 
2 sin — 
2 (3.215) 


y Ul ay Ain ea 
Oe, u, coskx = 5 = pa u, sin (+7) (3.216) 


2 sin — 
2 
Obviously, these transformations of trigonometric series can 


conveniently be employed in the case when the u, tend to zero slowly 


and lim 4u,/u, = 0. The improvement in the convergence will be 
k > co 
the greater, the faster 4u,/u, tends to zero. 


If transformation (3.214) is applied a second time to series (3.215) 
and (3.216), we get 
— ‘ Uy x ] = 2 ‘ 
>. up Sin kx = ( u,—— } cot =— Y 4?u, sin (k + 1)x 


hm] 2 2 4 sin? = 
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and 
3 up, COSkx = — + (u4— Up) ae >) A*u, cos (k + 1)x, 
a 4 sin? = Pee 


where 4?u, = u,,,—2u,,, +4; is a difference of the second order. 
For instance, if u, = 1/k, we have du, = 1/k(k+1), 


Atu, = 2/k(k+1) (kK +2), etc. 


8. A.N. Krylov’s method of improving the convergence of 
trigonometric series 


If f(x) satisfies Dirichlet’s conditions, it can be expanded as a 
convergent Fourier series: 


f(x) = s+ x (a, cos nx +6, sin nx), (3.217): 
ne} 


where the Fourier coefficients a, and b, are of order 1/n if f(x) 
is a function of bounded variation. Such a series is slowly convergent. 
It is possible to speed up the convergence by isolating the slowly 
convergent part. Let f(x) have bounded derivatives of the kth order 
everywhere except for a finite number of points x!0), x, ._., x0). 
At these points f(x) has a discontinuity of the first kind, the size of 
the jump A, being equal to 
hy, = f(x\? +0) — f(x -- 0) (i= 1,2, ... mp). (3.218) 
Suppose that the jth derivative also has discontinuities of the first: 
kind at the points x{?, xf’, ..., x2, with jumps 
AV = f(x) 4.0) — fA AM —0) (3.219). 
(i221, 2,..., m; j=l, 2,..., ). 
We can now write f(x) in the form 


mt 


mo | l 
f(x») = y = hyo — x{0) + > = AVa(x—xM) 4... 


mez | 
oe + Y= hPag(x— xf) +9(x), (3.220) 
[=1 
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or 
1 ; : 
fa) == ¥ D3 hPa x— x) + 9(>), (3.221) 
I=0 (#1 
where 
——- for —2x%<u<Q, 
= sin nu 
ool) = Ze nr a for O<u< 2x, (3.222) 
0 for u= 0, 2x, ~2n. 
= sch nu 
o,(u) = [- ao(t) du—F = — F SOM 
0 
2 2 
aes for —2r%susQ, 
=) , (0)? (3:223 
A — 
D r for Osu s 22. 
Further integration gives us o,(z): 
o,(u) = — = cil —— (Osus2zn). (3.224) 


The function g(x) is continuous along with its first k derivatives, 
and its Fourier series 


P(x) = 2+ Y° (aq cos nx-+f, sin nx) 
ne] 


is rapidly convergent, since the coefficients «, and £, have the order 
1/n®*?, If we take into account the expansions (3.222)—(3.224), the 
series for f(x) will be 
mo } © sin n(x— x}) 1 = cos n(x—x{P) _ 
x — },(0) ss Soe Sd IR A — hi elt ace dl SE 
I in = It hi 2 n -S5 wt py ne 
— F Lay § Sone) 5 


= 1 7% n=1 


: +524 y (z, cosnx+ 8, sinnx). (3.225) 
n=l 
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The slowly convergent parts have thus been separated out from 
Fourier series (3.217). 

We often obtain by some method the Fourier series for a function 
without knowing the function itself; here, if the series is slowly con- 
vergent, it is of little use for computing the values of the function, 
not to mention the values of its derivatives. It is often possible to 
improve the convergence in this case, by making use of familiar series 
for o(x—xX,), etc. This will be shown with the aid of an example 
(ref. 3). 

EXAMPLE 55. We are given the Fourier series 


as n cos n— 
f(xy) = --— YY — sin mx Osxsz2). (3.226) 
Tnay iN — 1 


We separate out the lowest power 1/m from the coefficient: 


ot ee 
e-1 nt we ee 


The initial series can now be split into three: 


7 
cos n= cos n= 
2 2 = : 
fxy=--—> sin nx —-— 5—— sin nx — 
% ysl Urner %N 
9 COSAS 


sinnx. (3.227) 


__ cosn = 
S(x)= -— > sin nx = 
n=l 
7 , 7 
igs sinn( x44) +sinn( x) 


~Hfo(ee8)ea(-$) om 
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as cos n 
S.(x) = eos = sin nx = 
sin 7 era Si 
i: és x 5 +sinn| x—-— 7 
iy n = 


m - E (=+ 2} +0, (x =) . (3.229) 


|» 
—_ 

o 

IIA 

x 

A 
tr] a 
KS 


Xx— 7 wv 
Six) =) Zz & =f = *), (3.230) 
0 (= =F); 
wt 0 ae sf 
ex *24* ( erat), 
So(x) = (3.231) 
. | oll SOD (F =x) 


Consequently, 


iS 
cos n= 
oo 


I(x) = S,(x) + So(x) = = oy Wn — 1) sin nx. (3.232) 


The remaining series is rapidly convergent (its coefficients are of 
order | /n5) and the expression (3. 232) obtained enables us to evaluate 
easily the values of the function and of its first derivatives. 

In the case when the series given above for dy, o,, 6, are insufficient 
for improving the convergence, the following series may prove useful: 


1 1 
COs x > COS 2x +7 60s 3x+ ...= 


= —Re[In|l—e*|] = — In| 2 sin (3.233) 
| 
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and its analogue: 


cos 2x cos3x cos aX. 
i aC 


. x 
2 sin — 


= (1—cos x) In 5 


+ & =) sinx+cosx. (3.234) 


By using these last series, we can improve the convergence of any 
series of the form 


= | i ore ] es 
Dy (4 (=) sin nx5>+B (=) cos my sin nx + 
1\. l 
+ (c (=) sin 2X) +D 6 cos ms COS mx : 


where A(1/n), B(1/n), C(1/n), D(i/n) are analytic functions of 1/n 
for small values of the argument. 


9. A. S. Maliev’s method of improving the convergence of 
trigonometric series 


The Fourier series of a function is slowly convergent if it has deri- 
vatives of all orders inside the interval (0, 27), while the function 
or one of its derivatives has different values at x = 0 and x = 2z. 
The following method was proposed by A. S. Maliev for obtaining 
a rapidly convergent trigonometric expansion of a function of this 
kind. 

Let f(x) be given in the interval (0, z), where it has continuous 
derivatives up to and including the (k—1)th order and the kth 
derivative satisfies Dirichlet’s conditions. This function can be expand- 
ed as a series in functions cos 2mx and sin 2nx, or as a series in sin 
nx only or in cos nx only (depending on whether the continuation 
of f(x) into the interval (—, 0) is even or odd). These series are 
in general slowly convergent. We can arrange for order 1/n*+} in 
the Fourier coefficient if we first continue the function into the 
interval (—z, 0) in such a way that, when continued periddically 
on to the whole of the real axis, the function has & derivatives, where 
the Ath derivative satisfies Dirichlet’s conditions. 
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For this, we take f(x) in the interval (—2, 0) in the form, say, of 
a (2k— 1)th degree polynomial o(x), having, along with its derivatives 
up to the (k—1)th order, values at the points 0 and x, respectively, 
equal to the values of f(x) and its derivatives at x = 0 and x = 2. 
We can conveniently choose 9(x) as 


G(x) = (x+7)" | dot Ave + es oo] 4 


+ x | Bo + Bc +7)+.. +h (x +h ‘ 


The coefficients Ay, A), ..., Ap_,; Bo, By, .--, Bz, are now deter- 
mined successively from the equations: 


9(0) = z*Ay = f(0), 
¢’(0) = krk-14, +7"A, = f (0), 
p*-D0) = CP k(k— ve . Ag t+ Ch_yk(kK— 1)... 30? A+ . 
Ck-2kr*-14, _, iC h-tnhAy os fir-110): 
o(—) = ( dis = fix), 
p(—2) = k(—2)*-1B, + (—2)'B, = f'@), 
ph) = Co_k(k—1)...2(—2) By t+ 
+ Ch ik(kK-1)...3(—-2)*B, +... 
. + CR}(—z)P By = fO-Y (a). 
After constructing the polynomial (x), we get the function 
g(x) for -xzs=xxs0, 
p(x) = 
S(x) for OB xs. 

This function, continued periodically, has k—1 continuous deriva- 
tives and a kth derivative satisfying Dirichlet’s conditions. The 
Fourier series for y(x) is as convergent as 1/n**1 and yields f(x) in 
the interval (0, 2). 

EXAMPLE 56 (ref. 3). 


f®e)=x-5  Osxs2). 
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Let k = 3 (for convergence of the order 1/n*). Now, 
1 5 6 
1 5 6 3 


On expanding as a series the function 


Q(x) (-7™sxs0), 


ae os (0 sx =n), 


we get 


240 ] 12 1440 1. 
f(x) = aa a) cos ae ae” es, ae nx. 


CHAPTER IV 


ORTHOGONAL SERIES AND 
ORTHOGONAL SYSTEMS 


Introduction 


A sequence of functions {f,,(x)} is said to be orthogonal in the 
interval (a, 5) if, for i + j, 


[. Fix) f(x) dx = 0. 


An important role is played in analysis by the representations 
of functions as orthogonal series: 


Y CnIn(X), 

nel 
l.e. series in an orthogonal system of functions. Trigonometric series 
are the classical example of orthogonal series. 

The theory of orthogonal series arose in connection with the. 
solution of problems of mathematical physics by the so-called Fourier 
method. Linear integral equations with symmetric kernels may also 
be solved by means of orthogonal series. 

The theory of orthogonal systems of functions has a remarkable 
analogy with the theory of orthogonal systems of vectors (see Chapter 
II, § 1). This analogy was observed long ago and has been reflected 
in the terminology. It led in the course of time to the conception 
of Hilbert space — the infinite-dimensional analogue of n-dimensional 
Euclidean spaces (see Chapter II), the role of orthogonal systems 
of vectors being played in Hilbert spaces by orthogonal systems 
of functions. To provide a valid basis for the theory of orthogonal 
systems of functions, the basic concepts of analysis had to be gener- 
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alized; in particular, generalization of the concept of integral led 
to the Lebesgue integral. 

The more elementary part of the theory, and especially the “com- 
putational” side of it is described in the present chapter. Unless 
there is a special proviso, the integral is understood in Reimann’s 
sense throughout this chapter. 

n-dimensional vectors can be interpreted as functions defined at 
n points; this interpretation is discussed in broad outline in $1, 
sec. 1; it throws into greater relief the analogy with orthogonal series 
of functions. Biorthogonal systems of functions — the analogues of 
biorthogonal systems of vectors — are discussed in § 2, sec. 6. The 
first example of such a system was offered by P. L. Chebyshev in 
connection with interpolation problems. 

Orthogonal systems of functions are connected with problems 
of approximation of complicated functions by simpler ones, when 
the measure of the closeness of two functions f(x) and (x) is provided 
by their square derivation: 


I. fe) — pP dr. 


The problem of the best approximation (from this point of view) 
of a function by polynomials led to the creation of the theory of 
orthogonal polynomials (the simplest system of orthogonal functions). 
The first example of an orthogonal system of polynomials was the 
system of Legendre polynomials. The general theory of orthogonal 
systems of polynomials is due to P.L. Chebyshev. This theory is 
described in § 3. 

The classical systems of orthogonal polynomials are discussed 
from a unified view-point in § 4, sec. 1-4. 

The later sections of § 4 are devoted to concrete systems of poly- 
nomials — those of Legendre, Jacobi, Chebyshev, Hermite, Laguerre 
(as also Chebyshev’s analogue of Legendre polynomials for a finite 
number of points). Good uniform approximations of functions 
can be obtained in a number of cases with the aid of segments of 
series in orthogonal polynomials. Such approximations are obtained 
very Often from segments of series in Chebyshev polynomials (see 


§ 4, sec. 7). 
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§ 1. Orthogonal systems 


1. Orthogonal systems of functions defined at 7» points 


Logically, the simplest example of an orthogonal system of functions 
is provided by a system of functions that are defined at n points. 
We shall confine ourselves to functions of one variable (everything 
said can be generalized immediately to functions of several variables). 

Let x,, Xo, ..., x, be a finite set of numbers (or points of the 
real axis) and let f(x,) be functions defined at these points. Each 
such function can be regarded as a vector f with components f, = /(x;) 
(i= 1, 2, ..., ). The length or norm of such a vector is 


fll = [Sf (4.1) 


The set of these vectors (functions) forms an n-dimensional Euclidean 
space, which is denoted by the symbol E,(x, x3, ...,X,) (see Chap- 
ter II). 

A basis in E, (x, Xg,..-) X,) 1S any system of m linearly in- 
dependent functions f™, f®, ..., £™ on the set xy %_, ..-) Xp 


2. Orthogonal systems in E,(x,, Xo, ..-, X,) 


Functions f(x;) and 9(x,) are orthogonal on a set of points x, x9, ..., 


Xs it 


n°? 


9) = ¥ fir = ¥ fxd) = 0. (4.2) 


which corresponds to the orthogonality of the vectors with coordinates 
f,and 9{i= 1,2, ..., 7). 

A system of functions f™ (x,) (kK = 1,2, ..., J of E, (x1, Xe) -- +> Xp) 

is said to be orthogonal if 

(f%, f™) = ' O12 > 0 for k=j, 


4.3 
0 for k #/j. ee) 


An orthogonal system of n functions is described as complete. 
There exists in E,, (x,, X2, ..-, X,) an infinite set of orthogonal 
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systems of n functions {f”} (j= 1, 2, ..., m); the functions of 
each such system form an orthogonal basis in space E,, (X,, Xq, ...5 Xp) 
Every function f(x,) of E,, (x1, ..., X,) 18 linearly expressible in terms 
of the functions of an orthogonal basis: 


n . 

t(%i) = ry cy f (xj). (4.4) 
J= 

The coefficients c; in (4.4) are called the Fourier coefficients of the 

function fin the system of functions f™, f, ..., f°, where 


5 = (f £9) = ¥ fxd fH). (4.3) 


The coefficient c; is the projection of the vector fon to the base vec- 
tor f. 

If || f || = 1 for all the f (j = 1, 2, ...,”) of an orthogonal 
basis, the basis is said to be orthonormalized. If the basis f® (j = 1, 2, 
..., ”)is orthonormalized, we have for any function /(x,) of E, (x, 


Kay. sng): 


If = ¥ (4.6 


where the c,; are the Fourier coefficients of the function fin the ortho- 
normalized system {f¥)} (this follows from (4.4) and the linear 
properties of the scalar product). 

If an orthogonal normed (j|/% || = 1) system is not complete, i.e. 
the number of its elements / < n, instead of equation (4.6) we have 
the inequality 


I 
fl? = 2, ch. (4.7) 
j= 
Equation (4.6) and inequality (4.7) transform in the limit as 2 + 


to Parseval’s equation and Bessel’s inequality respectively (see § 2, 
sec. 4). 
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3. The best mean square approximation 


The square approximation of a function f(x) by a function ¢(x) with 
respect to a system of points x;, X2, ..., x,, is defined by 


fell =) Ued- ea? (4.8) 


We shall discuss generalized polynomials of the ith order, i.e. 
functions of the form 


y dy f(x), (4.9) 


where {f} (k = 1, 2, ..., J; |< n) is an orthogonal system of 
functions of E,, (xX), Xe, ...; Xq)- 

THEOREM 1. From among all the “generalized polynomials” of the 
l-th order (1 = n), the best mean square approximation of a function 
S(x,) at the points x, X_, ..., X, is given by a polynomial of the form 

t 


y crf), (4.10) 


ke] 


where c, are Fourier coefficients. 
This /th order polynomial coincides with the sum of the first / 
terms of sum (4.4). This best approximation vanishes when / = n. 


4. Orthogonal systems of trigonometric functions 


The most important examples of orthogonal systems on a finite 
set of points are first the orthogonal systems of polynomials introduced 
by Chebyshev (see § 4, sec. 11), and secondly, orthogonal systems 
of trigonometric functions. 

EXAMPLE 1. The system of functions {cos kx,} (k = 0, 1, 2, ..., ”) 
is orthogonal on the system of 27 points x; = ixn/n (i= 0, +1, £2, 
..s, tn—1, —n). Any even function f(x,), defined at these points, 
is expressible by the sum 


nr 
f(x,) = Toe Cp COS Kx, (4.11) 
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where 
n-—1 


l 
Cr = Wn > S(x)) cos kx; 
i= —n 


EXAMPLE 2. The system of n—1 functions {sin kx,} (kK = 1, 2, ..., 
n—1) is orthogonal on the system of 2n—1 points x, = iz/n (i= 
=+1, +2,..., tn—1, —n). Any odd function ¢(x,), defined at 
these points, is expressible as 


n—1 
Ox) = Yc sin kx, (4.12) 
K=1 
where 
|. Re ; 
ae 2, g(x,) sin kx,. 


_= 


EXAMPLE 3. The system of 2” functions cos kx, sin /x, where 
k=0,1,2, ...,2;/= 1, 2, ..., 2-1, is orthogonal on the system 
of 2m points 


m= — (= 0, +1, +2, ..., tn—-1, —n). 


Any function p(x;,), defined at these points, is expressible as 


vx) = 2 +> (a, cos kx; +b, sin kx,). (4.13) 
where 
= = = y(x;) cos kx,, 
= by = a” w(x;) sin kx,. 


Formula (4.13) reduces to (4.11) if p(x) is an even function, and 
to (4.12) if p(x) is odd. 

Any periodic function »(x,), defined at all points x, = ix/n, where 
i is any integer, is expressible by (4.13), or by (4.11) or (4.12) if it 
is even or odd. 

These formulae, deduced by Euler and Lagrange, transform to 
(4. 42) and (4.43) asm + oo, They are atthe basis of numerical methods 
of harmonic analysis 
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§ 2. General properties of orthogonal and biorthogonal systems 


1. Orthogonality. Scalar (inner) product 


The orthogonality of two vectors in n-dimensional Euclidean 
space is well known to consist in the fact that their scalar product 
vanishes (see Chapter II, § 1, sec. 3). The orthogonality of functions 
is defined by analogy with the orthogonality of vectors. 

The scalar (inner) product of functions f(x) and g(x) on [a, b] is 
defined by the expression 


(fg) = | ” Aeelx) dx. (4.14) 


(We naturally assume here that f(x).g(x) is integrable in [a, 5].) 
If 


(f, g) = | ” feaelx) dx = 0, 


J (x) and g(x) are said to be orthogonal on {a, 5}. 

EXAMPLE 4. The functions sin x and cos x are orthogonal on the 
segment [0, 2], since 

a sin? x 
sin x cos x dx = 
I 

The orthogonality of functions with respect to a weight function 
is a further generalization of the concept of orthogonality. 

Let p(x) be a fixed non-negative function in fa, 5]. 

Any two functions f(x) and 2(x), for which 


r Fede(ap(x) dx = 0, (4.15) 


0 


are said to be orthogonal on the segment [a,b] with respect to the 
weight p(x). 

EXAMPLE 5. The functions sin (marc cos x) and cos (narccos x) are 
orthogonal on [—1, +1] with respect to the weight 1//1—x?, since 


+1 
| sin‘(n arc cos x) cos (m arc cos x) dx = 


1 
-1 J1—x* 


= sin mu-cos nu du = 0. 
0 
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All the integrals considered in this chapter will be assumed to 
exist in Riemann’s sense. 


The concept of orthogonality can be generalized in a natural manner for 
functions f(x), g(x) and the weight p(x), which are Lebesgue but not Riemann 
integrable. 

Let p(x) be non-negative in (a, 5], non-zero on a set of measure zero and Lebesgue 
integrable on [a, 5}. Now, 


l 
p(x) dx > 0. 


a be b 
Let f(x) be such that | £°(x) dx exists in the Lebesgue sense. Then | /f? (x)p(x) dx 


a a 
also exists. We say in this case that f(x) is square integrable with respect to the 


weight p(x) on [a, b] (in the Lebesgue sense), and we write | BN b) for the set 
of such functions. 

If p(x) a1, we use the simple notation L*(a, b). 

For instance, the function f(x) =x"? belongs to L°(0, 1), whereas f(x) = x7! 
does not. 

The following proposition holds: if f(x) and g(x) belong to L5,.,(a, 5), then 


b 
| S(x)g(x)p(x) dx 
a 


exists, and the Cauchy—Bunyakovskii inequality holds: 


b f>  #&+ ~o 
| Sf (x)g(x)p(x) dx = | | f?(x)p(x) «| g*(x)p(x) dx 


a a a 


(this latter is a generalization of the corresponding inequality for vectors, see 
Chapter II, § 1, sec. 2). 


The scalar product in L},.,(a,b) of functions f(x) and g(x) is defined by the 
expression 


b 
(f, g) = | f(x) g(x) p(x) dx. 


a 


The functions f(x) and g(x) of L,,,(a,b) are said to be orthogonal with respect 
to the weight p(x) if (4 g)=0. 


Let o(x) be a non-decreasing function in [a, d]. Let us consider 
the functions f(x), for which the Stieltjes integral exists: 


{. F(x) do(x). 
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b 
In this case | (x) do(x) also exists The set of such functions 


a 
will be denoted by L?,..,(a, 5). 
There exists for any two functions f(x) and g(x) of L3,,,(a, 5): 


[. flx)g(x) do(x) (4.16) 


and the corresponding Cauchy—Bunyakovskii inequality holds. 
Integral (4.16) is called the scalar (inner) product of functions f(x) and 
g(x) of L2,.(a, 6). 

The functions f(x) and g(x) are said to be orthogonal with respect 
to the integral weight o(x) if 


(f, g) = | ” flxde(x) do(x) = 0, 


i.e. their scalar product vanishes. 
In the case when o(x) has a finite number of growth points: x, 
Xo, ..+) Xp, integral (4.16) becomes the finite sum 


> Pode [o(x; +0) — o(x; — 0]. (4.17) 


If all the jumps of o(x) are equal to 1, 1.e. 
o(x;+0)—o(x,—0) = 1 
for all i, (4.17) becomes 


> forded. (4.18) 


The orthogonality of f and g is influenced here only by their values 
at a finite number of points — the growth points of o(x). In this 
connection, the functions f and g can be regarded as specified only 
at these points (as in § 1, sec. 1). In this case (4.18) is the ordinary 


scalar product of the vectors f and gz of E niXis -+-» X,)- The case 
when o(x) has a finite number of growth points is singular inasmuch 
as it is only in this case that there exist only n linearly independent 
mutually orthogonal functions (see § 1, sec. 1). 

The above concepts relating to the orthogonality of two functions 
are united by a common property: the inner product of the functions 
J(x) and g(x) is in each case equal to zero. The whole of our sub- 
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sequent discussion (unless there is a special proviso) will be independent 
of the particular method by which the concept of inner product 
is introduced. We shall thus use in general the symbol (/, g) to denote 
the inner product of /(x) and g(x), i.e. this symbol may be defined in 
any of the ways described. The case when 


(f, 2) = | ” floelx) dot). 


unites all the other definitions of scalar product. The case of a “differen- 
tial” weight p(x) is obtained from this when o(x) has an integrable 
derivative, and do(x) = p(x) dx, so that integral (4.16) becomes 


| ” Ae(x)p(x) dx. 


Orthogonality without a weight is the case when do(x) = dx. The 
orthogonality of functions defined at a finite number of points corres- 
ponds to a finite number of growth points of o(x). 

In future, we shall therefore use expression (4.16) for (f, zg), where 
necessary. 


The scalar product of the function f(x) with f(x), i.e. (4 f), is usually 


denoted by || /||? and ||/]| =VC/) is called the norm of the function. 
This quantity is the norm of f(x) in the corresponding normed space. 


The quantity 
b 
fell = _| | (f— 2) do(x) 


is called the root square deviation of functions f(x) and g(x). This 
is the measure in the accepted sense of the closeness of f(x) and g(x). 


2. Orthogonal systems of Bessel functions, Haar functions, etc. 


Let any two functions of the sequence 


P(x), P(X), ce ey Pn(X); eee 
be orthogonal on (a, 5), i.e. (p;, 9;) = 0 if i ¥ j. 
Such a sequence is described as an orthogonal system of functions 
on (a, 6). If the system of functions 


93(x), Po(x), se ey Pn(x), atone 
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is orthogonal and each of the functions differs from zero, the system 
of functions 


_ i) _ _ Po{x) _ _ n(x) 
2 = Tee? @) = Tecan? 7? = Tey 


is also orthogonal. Every function of this system satisfies 


pti] = Jy pd = 1. (4.19) 


Such systems are extremely convenient. They are described as 
orthonormalized (or orthonormal). 
The orthogonal system 
(x), Po(x), ..-, Pn(x), ... 


is said to-be complete in the space L? (a, b) if, among all the 
functions of Lixx(@, b), there is none that is non-zero and orthogonal 
to all the functions of the system 


P(x), P2(x), eery Pp (x), eee yg 
i.e. the fact that 


| ” fe\pa(x) do(x) = 0 


for all n, implies that 
f(x) = 0 


(excluding possibly a set of measure zero). 

In the case of a finite number of growth points of o(x), a complete 
system contains as many functions as there are growth points of 
a(x). 

EXAMPLE 6. The system of functions 

sin x, sin2x, ..., SINMX, ... (4.20) 
is orthogonal on (0, 2), since 


& 
|" sinmxsinnx dx = 0 for msn. 
0 


The system is complete. 
EXAMPLE 7. The system of functions 


1, cosx, cos2x, ..., COSMX,... (4.21) 
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is orthogonal on (0, 2), since 
z 
| cosmxcosmxdx=Q for m<#n. 


0 


The system is complete. 
EXAMPLE 8. The system of functions 


1, sin x, cos x, sin 2x, cos 2x, ..., simmx, cosmx, ... (4.22) 


is orthogonal on (0, 27), since 


2a 
| sinmxcosnxdx =Q for any m anda, 
0 


2x 
| sinmxsinnxdx=0Q0 for m<#n, 


2x 
[ "cos me cosmx dx = 0 for msn 


(m= 0, 1,2,...5 2=0,1,2,...) 


The system is complete. 
The system of Bessel functions. Let J,(x) be the Bessel function of 
order n, and A,, Ay, ..., A, ... the positive roots of the equation 


J,(x) = 0 
or of the equation 
Ji(x) = 0. 
The system of functions 


Fr(ArxX),  In(Aex),  In(Asx), -- + In(Aax), --- (4.23) 


is now orthogonal in [0, 1} with respect to the weight x, since with 
iff: 
{. Ty(Ayx Indy) dx = 0, 
0 

The system (4.23) is complete. 

The system of Haar functions. Inrecent times a use has been found 
for the orthogonal system of Haar functions. This system consists 
of piecewise constant functions y"(t), where 
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x(t) = 1 

l 

¢(t) = as] 
QO. 

ald 

h(t) oe _ Jz 
0 

iD 

WP) =) J? 
0 

Z 

et) = = 
y2\(t) = . 9 
0 

2 

12) = 9) 
0 


. for 


té (0, 1]; 


] 
for 1/0, z) 
for ¢t€ uu l 
2 9 


for 
for ft€ [o. 


] } 
for t€ (F- z/ 


at other points; 


] 3 
for ely z) 
3 
for e(Z |, 


at other points; 


for t € fo. :) > 
l 
for eg 7) 


at other points; 

for el Z: z) 
J] 

for ez 7 | 


at other points; 


m vel 8) 
m os(E 3} 


at other points; 


(4.24) 
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2 for té€ Ee z) : 
421) = 
v) -2 for té & |, ve 


QO at other points. 
In general, 
WO=JVF, a= -VF 
/2" for e| Far or): 
WO=) _ aR for 1 — a (4.25) 
0 at other points (0, 1]. 
The Haar functions are generated from the “polygonal functions” 


of Schauder’s basis. The orthogonality of the Haar system follows 
from the fact that, given the same 7, 


eD()yt) =O for jek Zl, 
so that 
(x, {)) = 0. 


Given different subscripts m and n, where m> n, and any j and k 
the sub-intervals, where ‘*)(t) # 0 are wholly contained in the intervals 
of constancy of y}(t) for m> n, and 


f 
[. x®(thyDt) dt =A ia y®)(t) dt = i( Be -) = 0, 


ati 


where 2 is the value of v2) on the interval of constancy. 

The system of Haar functions has an important approximation 
property: the Fourier series (see Chapter I]]) of any continuous function 
with respect to the Haar system is uniformly convergent to it in [0, 1]. 

The concept of orthogonality of functions of one variable on a 
segment may be generalized in a natural manner to functions of several 
variables, defined in some domain. 
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The functions f(P) and g(P) of a point P of n-dimensional space are 
said to be orthogonal with respect to a domain D of this space if 


| S(P)g(P) dP = 0. (4.26) 
D 


A similar definition can be given of the orthogonality of f(P) and g(P) 
with respect to the weight k(P): 


| K(P)g(P)K(P) dP = 0. (4.27) 
D 


EXAMPLE 9. The problem of the vibrations of a plane clamped mem- 
brane leads to the differential equation 


(where A is Laplace’s operator) with the boundary condition U = 0. 
The eigenfunctions of this equation, corresponding to different values 
of A, are orthogonal: 


| | U(x, YU, y) de dy = 0 
G 


EXAMPLE 10. Let 9,(x), Yo(X), . . -. Py(x),...beasystem of functions 
orthogonal on the segment [a, 5]. The system of functions 


Ui, (x, V) = O()9;(9) (4.28) 


is now orthogonal with respect to area on the square a= x= b, 
asyzb. 


b fb 
For | | pio O)erdPO) de dy = 
aga 
b b 
= | u(x dpr(x) dx { i(9)91(9) dy = 0, 

a a 
if either i + k or j ¥ I, ie. if U, (x, y) and U, ,(x, y) are different 
functions of system (4.28). 


Systems of the form (4.28) are utilized, for example, in the expansion 
of the symmetric kernel of the integral equation 


Ox) =A | ” K(x, s)o(s) do-+fe) (4.29) 


as a Series in the eigenfunctions of the equation. 
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If {p,(x)} is a normed system of eigenfunctions of (4.29), corres- 
ponding to the eigenvalues 1/A,, while {O,(x)} is asystem of eigenfunc- 
tions corresponding to the zero eigenvalue, the system of functions 
(where i and j are arbitrary): 


P(x)9,(5), Oilx)p,(s), Pilx)O,(s), O(x)O,(s), (4.30) 


is orthogonal on the square (a = x S b; a= 53 b), since the system 
{p(x), O,(x)} is orthogonal on [a, 4]. 

System (4.30) is complete in the space of functions square integrable 
on (asx 6b; a=s=zb). Hence the square integrable function 
K(x, s) can be expanded as a series in this system. The Fourier coeffi- 
cients of the function K(x, s) with respect to the functions 9,(x)9¢,(s) 
for i # j, O,(x)p{s) and 9(x)O,(s) vanish for any i and j, while with 
respect to the functions 9,(x)p,(s) they are equal to 1/A,, by virtue of 
the relationships 


| | ” K(x, s\p(x)9,(s) dx ds = | pide | Cer e 


a a 


] b ° ° e 
=—| o(x)o(x)dx =0, if iy; 
Ay |, 


[. | ° K(x, s)p;(x)O,(s) dx ds = | p;(x) dx | ° K(x, s)O,(s) ds = 0, 


a a 


| | ” K(x, s)pi(x)p(s) dx ds = | ees | ” K(x, s)p,(s) ds = 


1 2 l 
= 7, | rene a = 7, 
tJa 
ae 
Hence K(x, s) = Xs = Pilx)Pi(5). 
= i 
The concepts of orthogonality of functions with respect to surfaces 
and curves can be treated in the same way as the above orthogonality 
of functions in a domain D of n-dimensional space. For instance, the 


spherical Laplace functions are orthogonal with respect to the surface 
of a sphere. 
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3. Linear independence. The process of orthogonalization 


A system of 7m functions is said to be linearly independent if, given 
any system of m numerical factors, for which 


the function 4,9,(x)+A.9.(x)+...+4,9,(x) is non-zero. If there 
exists a system of factors A; such that 


AyPy(X) + AgPo(x) +... +AnPn(x) = 9, (4.31) 


where at least one 4; differs from zero, the system of functions ¢,(x), 
P(X), - - -» P(x) 18 said to be linearly dependent. (In the case of func- 
tions of L2(a, b), equation (4.31) can hold for a linearly independent 
system on a set of measure zero.) 

The concept of linear independence of functions is similar to the 
concept of linear independence of vectors of n-dimensional vector 
space (see Chapter ITI, § 1, sec. 4). 

Let the inner product (¢;,¢9;) be defined for any pair 9,(x), ,(x) of 
the function system 9,(x), 92(x),..-, Pp (x). 

In analogy with the Gram determinant for a vector system (see 
Chapter II, § 1, sec. 5), we introduce the determinant 


(Pr, Pr) (Pr, Po) «+- Gr Pn) 
An ma (2, Py (G2, P2) eos (Pe; Pn) : (4.32) 


* e® 8 © @® &® e&® @® e® @® ®© &® e@ @ @#® @ 


(Pn Pi) (n> Po) «++ (ns Pn) 


which is called the Gram determinant of the function system. 

Properties of the Gram determinant. 1°. The Gram determinant 
A,, = 0 for any system of functions. 

2°. Let the system of function, 7, go, ..., ¢,, be defined on the seg- 
ment [a, b] and let the interval (a,, b,) be contained in (a, b). 

Now, if 4,, is the Gram determinant of the system in [a, 5] and 
(~;, p;) is defined by 


b 
(9) = | ps(x)p,(x) do(x) 
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while 4’, is the Gram determinant of the same system in [a,, 3], 


we have 
, 
A, = 4. 


This property also holds for the Gram determinant of functions of 
several variables in a domain Q: the Gram determinant can only 
diminish when the domain diminishes. 

THEOREM 2. The necessary and sufficient condition for a finite system 
of functions to be linearly independent is that its Gram determinant 
be different from zero. 

_ THEOREM 3. Every finite orthogonal system of functions is linearly 
independent. 

Theorem 3 is an obvious consequence of Theorem 2, since the 
Gram determinant of an orthogonal system of functions is equal to 
the product of the squares of the norms of all the functions of the 
system, each of which is greater than zero. 

An infinite sequence of functions 9,(x), 9,(x), ..., p,(x), ... 
is said to be Jinearly independent if any finite sub-system of it is linearly 
independent. 

Given the system 9, qo, ..., y, Of linearly independent functions 
and some function f(x), let us consider the problem of the best root 
Square approximation of f(x) by means of linear combinations of 


n 
the system, i.e. from all the linear combinations }' d,p; we find the 
i=1 
one that gives a minimum for the expression - 


2 


The coefficients of the best linear combination are found from the 
system of linear equations 


<a 
dd; 


Ay, Pi) + (Ho, V1) + --- +da(Pns Pr) = Ch Pds_ 
A(H,, Po) +4a(Ho, Po) +... +4r(Pn, Pr) = Cf, Oa); (4.33) 


oo e@© ® ee @# e# e@# @® @® «© @ ® @ ® @ @ @® @® ee @® e® @® ® @® @® @ @® @ 


Gy(P1, Pn) + (Po, Pn) + --- +4n(Pns Pn) = (4 Pn)- 


n 
f-¥ dg; 
i=1 


2 
)=0 (k = 1, 2,..., n), 


1.e. 
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The determinant of this system is the Gram determinant; in view 
of the linear independence of the initial system, it differs from zero 
and (4.33) has a unique solution. Obviously, it is easiest to find the 
coefficients d,, d,, .. ., d, from (4.33) if the initial system is orthogonal. 
In this case (4.33) becomes the system 


An(Prs Pr) = C15 Pr) (A = 1, 2,..., 7). (4.34) 


By starting out from any (finite or infinite) linearly independent 
system of functions (or vectors), an orthogonal system can be formed, 
the elements of which are certain linear combinations of the elements 
of the initial system. Let us consider the process of forming such a 
system. It is called a Schmidt orthogonalization process. 

Suppose we are given the linearly independent system 


Yi; Py, eery Pns eee e 


We put 
P(x) 
o,(x) = ———;,- 
(Q,, 9)” 
Let 


Wo = Po(X)— Cy,,(x). 


The coefficient c., can be chosen so that (y., w,) = 0, by putting 


Having chosen such a cy, we put 


p,(x) 


= (Pe, p2) oa 


Here (2, #2) # 0, since otherwise ,(x) = 0, and this would mean 
that m, and ¢, are linearly dependent. 

Suppose that functions @,, w.,..., @,_, have already been found. 
We now put 


Pr(X) = Pp(x)— > Cni@;(x), 


here the numbers c,,, are chosen so that y,(x) is orthogonal to all the 
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functions @,(x), ..., @,_,(x). We must take for this: c,; = (p,, @,). 
We next put @,(x) = »,(x)/(Y_, Y,)'”, where (y,, Y,) ¥ 0 in view of 
the linear independence of the functions 9, ..., p,_,. This process 
can be continued indefinitely. 

The system @,(x), ..., @,(x),... thus formed will be orthonormalized 

The process of orthogonalization of a vector system is precisely 
similar. 

In the case of a vector system in n-dimensional space, or of a system 
of functions defined at n points, such a system contains not more than 
n elements. 


4. Fourier coefficients. Closed systems 


Let 
©1(x), @(x), .. +5 On(X), .-- (4.35) 


be an orthonormal system of functions. Given a function f(x), suppose 
that its inner product exists with any function of the system. The 
numbers c,; = (/, w,) are called the Fourier coefficients of f(x) with 
respect to system (4.35) In the particular case when (4.35) is a trigono- 
metric system, the c; are the familiar Fourier coefficients of the theory 
of Fourier series. 

The Fourier coefficients of functions are the analogues of the pro- 
jections of a vector on to the vectors of an orthonormal vector system. 
If all the Fourier coefficients of a function exist, we can formally 
construct the series 


Y cra(x) (4.36) 


This series is called (in analogy with the corresponding series with 
respect to the trigonometric system) the Fourier series of f(x) with 
respect to the system @,(x), ..., @,(x),... - 

Bessel’s inequality and Parseval’s equation. We can write Bessel’s 
inequality for any f(x), for which (f, f) and all the Fourier coefficients 
exist: 


Lasts (4.37) 
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from which it follows that the series } c? is convergent and 


i=l 
ze cs(f, f). (4.38) 
In the particular case when )) c? = (f,f), (4.38) is known as Parseval’s 
n=l 
equation. 
Let 
W(X), W(x), ..., O,(x), ... (4.39) 


be an orthonormal system of functions on (a, 5), and f(x) a function 
defined on (a, b) for which (f, f) exists. 

When considering the problem of the best root square approximation 
of f(x) by the linear combinations 


S' do,(x), 
i=1 : 


we arrived (see sec. 3 of this article) at an expression for the coefficients 
of orthogonal system {w,(x)} giving the best approximation (4.34): 


a f, Wp) 
. (o,, Wp) 
which yields in the case of a normed system: 
d;, = GA W») = Cp. 


From this there follows: 


nr 
THEOREM 4, Ofall the linear combinations }' djw,(x), the finite Fourier 


sum tal 


, c,0;(x) 
=i 


has the least root square deviation from f(x) (i.e. the linear combination 
for which d; = ¢;). 

The orthonormal! system (x), ..., @,(%), ... iS said to be closed 
if Parseval’s equation is satisfied 


Dy = {. I*(x) do(x) (4.40) 
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for any function f(x) of L2,,,(a, 5). In this case, 
b n 
| f(x) do(x)—- ¥ ci +0 as n+oa, 
2 ist 
which implies, in view of the equation 
b n b nr 2 
| f@) do) — F & = | [fe aS coo) | da(.x) 
a i=1 a i=] 
that the root square deviation 


b n 2 
| | f(x)- 2 coo) | do(x) (4.41) 
a = 
tends to zero aS n + ~. 

If (4.41) tends to zero as m + , we say that the Fourier series 


» c,0;(x) 


is convergent in the mean to f(x). 

Consequently, if f(x) belongs to L?,,.(a, b), its Fourier series with 
respect to any closed system is convergent to it in the mean. 

EXAMPLE 11. The trigonometric system (4.22) is closed in (0, 27.) 

EXAMPLE 12. 

THEOREM 5 (V. A. Steklov). The set of eigenfunctions of the Sturm— 
Liouville equation forms a closed system. 

It was in the context of this theorem that V. A. Steklov introduced 
the concept of closure of a system. 

It follows from Parseval’s equation that every orthogonal system, 
closed in L?,.,(a,5), is complete, and every complete orthogonal system 


o(x) 
in L?,.,(a, 5) is closed. 


5. Fourier series in a trigonometric systemt 


The problem of representing an arbitrary function f(x) by a trigo- 
nometric series 


2 + ¥ (a, cos nx +b, sin nx) (4.42) 
Nel 


¢ See Chapter III for more detailed information on trigonometric Fourier series. 
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arose in the middle of the eighteenth century in connection with the 
problem of the vibrations of a string. This problem occupied all the 
greatest mathematicians of this period. The essential step in the solu- 
tion of the problem was taken by Fourier, who establishedt that, by 
virtue of the orthogonality of the trigonometric system, the coefficient 
of series (4.42) can be expressed in the form: 


a= x | 1 dx, 
0 


an = - | _ I(x) cos nx dx, (4.43) 
0 


Ox 
b, = =a J (x) sin nx dx 
0 


(hence the name Fourier coefficients in the case of any orthogona- 
system). 

Fourier stated the theorem to the effect that a (graphically) arbitrary 
function can be represented by a Fourier series. 

Historically, the first theorem on the convergence of Fourier series 
was: 

THEOREM 6 (Dirichlet, 1829). Any function that admits of integration 
in any interval in (QO, 2%) and does not have an infinity of extrema in 
the interval can be expanded as a Fourier series, which is convergent at 
every point x to the value 


f(x +0) +f(x— 0) 
; 


The crucial point in Dirichlet’s proof was the representation of 
the partial sum s,(x) of the Fourier series and of the remainder in 
the form of integrals: 


sin ante (x — a) 


5y(2) = [’ Oy) des 
é 2 


t This had been noticed before Fourier by Euler. 
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and 


2n+ 1 
1 = In ar ae (x _ a) 
fe)-s() = 5 | (fe)-f@) 
=e sin 


an a, 9 
x~-@ 
r) 


together with the following observations: 


(1) if0 < ¢ <2, then asn +=, 


[90 Sag +790: 


sin B 


(2) ifO0<b<cs =n and (8) is monotonic, then 


[7 p(B) + DE ag 9 as nN — 09, 


sIn 


A rather more general theorem may be proved by the same method. 
THEOREM 7. If f(x) is a function of bounded variation, its Fourier 


l 
series is convergent at every point x to the value z [f(x+0)+/f(x—0)]. 


If, in addition, f(x) is continuous at every point of some interval, the 
Fourier series is uniformly convergent in the interval. 
THEOREM 8 (Lebesgue’s Test). Let 


P(t) = 9,(t) = fix+D+fx-—)—-2f(x) 


and 
h 
©, (h) =| pat) | de. 
_|pe(0) 
If 
P(A) +0 as h-+O 
h 
and 


i [OSE iQ: ae Gee 


7 t 


the Fourier series of f(x) is convergent to f(x) at the point x. 
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THEOREM 9 (Dini-Lipschitz). If f(x) is continuous and its modulus 
of continuity w(6) satisfies the condition 


w(8) In +O as 6-0, 


the Fourier series of f(x) is uniformly convergent. 
THEOREM 10 (de la Vallée-Poussin). If the function 


t 
=> | 90d 
0. 


is of bounded variation in some interval with left-hand end point t = 0 
and y(t) + 0 as t + 0, the Fourier series of {(x) is convergent at the 
point x to the value f(x). 

THEOREM 11 (Hardy). Jf 


fix+h)—flx) =O (2 vt) | 


and the coefficients c,, of the series have magnitudes of the order O(n-°), 
where 6 > OQ, the Fourier series is convergent at the point x to the value 
J (x) (see Chapter I, § 3, sec. 8 regarding the symbols o(m) and O(n)). 


6. Biorthogonal systems of functions 
A biorthogonal system of functions on (a, b) is a system consisting 
of two sequences 


P(X), P(X), Gy(X), »-- > Pn(X), «+. 
Wo(x), YX), Po{X), -- +5 YnlX), --- (4.44) 


satisfying the following condition on (a, b): 
(Vi, 15) = 0:5, 
where 6,, is the Kronecker delta (see Chapter II, § 1, sec. 2). Here, 
b b 
the inner product (y,, ,) is either | Pp jy; ax or | py; do(x). In 
a a 


the latter case we speak of a system of functions, biorthogonal with 
respect to the weight a(x) or p(x), if do(x) = p(x) dx. 

Given any function, for which the inner products encountered later 
exist, we Can associate with it the series 
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fs) ~ ¥ Anon) (4.45) 
“me An = U6 Yn» 


and consider the question of the convergence of the series and the 
possibility of using segments of it for approximation to the function. 

EXAMPLE 13. Chebyshev’s biorthogonal system on (—1, 1) with res- 
pect to the weight p(x) = | is 


sin (k + 1)p 


Px(X) = Sign — = 


(4.46) 


where = COs (k= 0: 1,2; 23); 


while d in (4.46) runs over all odd divisors of k+1, including d = 1 
and d=k-+1 if this is odd; the function sign x was introduced in 
Chapter I, § 2, sec. 1; u(d) is the Mébius function, 1.e. 

wl) = 1; 

ula) = 0, if a is divisible by a square different from unity; 

u(a) = (—1)’, if a is not divisible by a square different from unity, 

and r is the number of prime divisors of a differing from 1. 

The functions ,(k) of this system are piecewise constant, while 
,(x) are polynomials in x having k simple zeros in (—1, +1). The 
first few functions of this system are given below: 


—1l for 


—1l for -l<x< —> 
l ] 
Q(x) = +1 for > <_xX<< zy? y'.(x) a2 (*-5): 
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$3(x) = ; | ya(x) = 2x(2x? — 1). 
—l in (0 =) ; 


EXAMPLE 14. Markov’s biorthogonal system in (—1, +1) with respect 
to the weight p(x) = 1//1—<x? is 


Po = ls Yo = 
(4.47) 


M, = Signcosky, yy, = 


where x = cos 9, d in (4.47) runs over all add divisors of the number 
k that do not contain square factors, and h 1s the number of prime 
factors of the form 4m-+1 contained in d(m # 0) (see Chapter I, 
§ 2, sec. 1, regarding the function sign x). 

Here, as in the Chebyshev system, y,(x) are piecewise constant, 
while p,(x) are polynomials in x. The first few functions of this system 
are given below: 


% = 1, Yo = 
—l1 in (—1, 0,) 


: in (-) Hie 


i 
7 
x 
v(x) = a2 


~1 in (-+ =) yal) = > (2x? 1), 


+1 in (= 1), 
2 
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2 2 
93(x) = p3(x) = 2x( x ee 
—1 in (0 3) ; 
2 
+1 in (2. ? : 


Series in Chebyshev and Markov functions are similar to series in 
sines only or in cosines only. 

On passing from polynomials and the interval (—1, +1) to tri- 
gonometric sums and the interval (—z, +2), we can combine both 
systems into one, which generates series corresponding to tngono- 
metric series of a general type. 

A biorthogonal system is called a Chebyshev—Markov system with 
respect to the weight o(x), if ,(x) is a polynomial of degree k, and 


p(x) = sign Q,(), 
where Q,(x) is a polynomial of degree k. 

THEOREM 12. The biorthogonal Chebyshev—Markov system for a 
given function o(x) is unique; the polynomial Q,(x) appearing in the 
expression for »,(x) is the polynomial of degree k with first coefficient 
1 for which 


[ | Ox(x) | do(x) = min | P,(x) | dot). 
—1 Px(x) J 1 


The system of polynomials 9,(x) is determined after this by means 
of a process similar to the Schmidt orthogonalization process (the 
metric of space Lj... is the natural one when considering series in the 
Chebyshev—Markov system). 


§ 3. Orthogonal systems of polynomials 


Various systems of orthogonal polynomials were introduced by 
Legendre, Jacobi, Chebyshev and other mathematicians The first of 
these historically was the system of Legendre polynomials. Chebyshev’s 
studies laid the foundations ofthe general theory of systems of ortho- 
gonal polynomials. 
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Let the system 
POs Pie ware: sau (4.48) 
where P,(x) is a polynomial of degree n, be orthogonal on (a, 5) 
(in particular, the interval may be infinite) in the sense that 


b 
(Pm Pp) = | Pm (x)Py(x) dot), (4.49) 
a 

where o(x) has an infinite number of growth points (in particular 
da (x)= p(x)dx, where p(x) is integrable in (a, 6)). Apart from a constant 
factor in the polynomials, the system (4.48) can be obtained by means 
of orthogonalization (see § 2, sec. 3) of the system of functions: 1, 
X1, X,...x",... Let us agree to write P(x) in future for polynomials 
of orthogonal system (4.48) defined by the condition that their first 
coefficient is equal to 1: 


P,(x) = 1, P,(x) = X + ao, eee 


ie (4.50) 
Be P07 eee ie eee i ee ee 
and P,(x) for polynomials of the orthonormal system, i.e. 
b a 
| P2(x) do(x) = 1. (4.51) 
a 


The Fourier coefficients of f(x) in an expansion in polynomials 
{P,,(x)} have the form 


ine | ” AaB, (x) do(x). 
In particular, if do(x) = G(x) dx, we have 
i | ” o(x)P, (x) dx, G(X) = f)G). (4.52) 


Notice, that, to evaluate integral] (4.52), it is not necessary to find the 
values of P,(x) throughout the interval]. On writing 


g- D(x) = | * g(E)dE and for i>s g(x) = i. gl-it+(E) dé, 


a a 


we obtain, by integration by parts, 
Cn = GV(D)P, (b)— p'-?(b)Py (B) +. E(— DEPT P-YB)PIB). 


Therefore, to find the coefficients cy, ¢), .. ., Cm, We only need to find, 
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by successive integration of ¢(x), the values of y‘—)(b), p‘—?(b), ..., 
g‘-™b), the values of the polynomials P,(x) (k = 1, 2,...,m), and 
their m derivatives (for k = 0, 1, ..., m) at the point D. 


1. Zeros of orthogonal polynomials 


THEOREM 13. The n-th degree polynomial P,(x) of the orthogonal 
system (4.48) has n real distinct simple roots, all of which lie in (a, 6). 

THEOREM 14. The zeros of the polynomials P,(x) and P,_,(x) of 
system (4.48) alternate: between any two zeros of P,,(x) there is a zero 
of P,_,(x). 

It follows from Theorem 14 that P,,(x) and P,,_ (x) have no common 
Zeros. 

THEOREM 15. If A(x) is the number of changes of sign in the series 
P(x), P(x), ..., P(x), the number of roots of the polynomial P(x) 
in the interval (a, B) is equal to the difference \(a)—A(B) (the property of 
so-called Sturm systems). 


2. Recurrence relations for orthogonal polynomials 


Let P, +9(*), P, 41); P(x) be any three successive polynomials of 
system (4.48), satisfying condition (4.50). In this case the following 
relationship holds: 


Pasa (X) = (Xn 42)Pnar(%) — AnarPn 00 (4.53) 


where the parameters ~,,, and A,,, are given by: 


xP2, ,(x) do(x) 


ano = | ’ 
| P2, (x) do(x) 

a (4.54) 

| P2, .(x) d(x) 


Anti = ey Gane arr 
| P2(x) do(x) 


Obviously, A,,, > 0. 
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The parameters a, , ., 4,,, are expressible in terms of the coefficients 
of polynomials P,,4, Pri Py: If 


= k-1 
P,(x) = xP + DY) apyx’, 
j=0 
then 
Sn+2 = Ansi,n—~ Inve, n41> 


An+t = Qn+1, n-1 ~ &n429n41, n ~ Ine2, n° 


It follows from formulae (4.54) that, if (a, 5) is a finite interval, 
we have for all n: 


where 
Qa<Gni.< 5, | 
0< An+1 = C*, (4.55) 
where c* = max(jal, |d]). | 


For examples of such recurrence relations see § 4, sec. 5-10. 


3. Power moments. The expression of orthogonal polynomials in 
terms of power moments 


The numbers 
b 
Un = | x” do(x) (4.56) 
a 
are called the power moments of the weight o(x). 
In the case of the system 
je Se ae ee cee 


the pair-wise inner products are expressible in terms of the power 
moments: 


b 
(x, x0) = | xx" do(2) = Ln 


a 


Gram’s determinant of the system of powers is 


FA ek — a ee eee eae ea ae x 0. (4.57) 
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The process of orthogonalization of a system of powers yields the 
expression for the polynomials P,(x) of (4.51): 


P(x) =~  Pe X| 4.58) 


nr 
Un Mn+1-++ Han-1 * 


and for the polynomials P,,(x) of (4.50): 


P, (x) = ie a me A (4.59) 


n 
Mn++» Hon-1 * 


The parameters « and A of the recurrence relation (4.53) can also be 
expressed in terms of the power moments: 


Ho ees Bn Banat 
eee aexcllage: nas 


Ho -++ Bn-1 En41 


oe Se el 
Pn +++ Hen-1 Hone 
where n = 0, 1, 2,...; 
Baek, — Ans :4n-1 ~ 
a An. = “Fa Ot =3:0,, Le Desc) 
while 4_, = 1. 


4. The connection between orthogonal polynomials and continued 
fractions 


The fraction 


P,, (t)— P,(x) 
t—x 
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is a Symmetric polynomial of degree m— 1 in tand x. Hence the function 
pi a 
Ry) = | Pal) Po (®) dott (4.61) 
P = 


is a polynomial of degree n—1 in x. 

The polynomials R,,, (x), R,(x) and R14) satisfy the same recurr- 
ence relation (4.53) as polynomials P,, (x), iP, 41%); P, (x). This 
fact indicates (see Chapter V) that R,,_ ,(x) and P_(x) are respectively 
the numerator and denominator of the mth order convergent of a 
Chebyshev type continued fraction: 

Ao A An 
cae es So ee (4.62) 
The polynomials R,,_ ,(x) are described as polynomials of the second 
kind with respect to the weight o(x). They are the denominators of 
the continued fraction 


ea, Pema ae a. see (4.63) 


X—Q@yp X—-G, = = X¥—Gqyy 


and are orthogonal with respect to some other weight. 

If the interval (a, 5) is finite, the sequence R,_(x)/P,(x) of conver- 
gents of the continued fraction (4.62) is convergent for all x lying 
outside (a, 5) to the value of the integral 


| gl (4.64) 


ax! 


When the interval (a, 5) is infinite, the contmued fraction (4.62) 
is not always convergent. The question of its convergence is related 
to the determination of the corresponding problem of moments. 

Regardless of the convergence, the continued fraction (4.62) is 
related to the integral (4.64) by the following property: the expansion 
of the convergent R,,_,(X)/P,(X) of (4 62) as a series in negative po- 
wers of x coincides as far as terms of the order 1/x®" (inclusive) with 
the series 


Ho Ae. 4 (4.65) 
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which can be obtained if the function 1/(x—?) in the integral (4.63) 
is expanded as a series in powers of 1/x and formally integrated term 
by term (the convergence of series (4.65) is of no consequence). 

A continued fraction of the Chebyshev type, possessing the above 
property, is described as associated (assoziierte, Perron, ref. 11) with 
the series (4.65). 

In the case o(x) = const, the continued fraction (4.62) can be trans- 
formed, for x < 0, into a continued fraction of the Stieltjes type 


ss iy te (4.66) 

QyX+ Ay -- A3X+ A+... 
such that the mth convergent of (4.62) coincides with the 2mth conver- 
gent of (4.66). In view of this, the expansion as a series in negative 
powers of x of the 2mth convergent of the fraction (4.66) coincides 
with series (4.65) up to and including the terms 1/x*". A fraction 
of the Stieltjes type, possessing this property with respect to the series 
(4.65), is described as corresponding to it (correspondierende, Perron, 
ref. 11). We know from the theory of continued fractions that every 
continued fraction of the Stieltjes type (with a,~0) has a correspond- 
ing series, and every continued fraction of the Chebyshev type has 
an associated series. 

The converse problem is of great importance in analysis: transfor- 
mation of a previously assigned series in negative powers of x into a 
corresponding or associated continued fraction, yielding rational 
approximations for the function given by the series. 

Notevery previously assigned series has a corresponding or an asso- 
ciated continued fraction. A series possessing this property is described 
as seminormal. 

THEOREM 16. The series 


fo 4 1 ee ae 
- tate tog t 


is seminormal if and only if all the determinants 


Co Ci “ee Cn-1 Cy Co eee Cn—-1 
pee es 6 C. C. er) We 6 C. C. 
Vy = 1 2 n and Yn = 2 3 n 
Cn—-1 Sn +++ Con—z Cn—1 Sn +++ Cons 


aré non-zero. 
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In this case, the coefficients of continued fraction (4.66) corres- 
ponding to this series are expressed in terms of ,, and y,, as follows 


Pr41Py-1 Wy+1P yp 
a=f;, 4, = —- 9 Gang) = 7 


PyPy Pr4i1Yv : 
where g, = 1, y, = 1. 
The fraction (4.66) corresponding to the series can be transformed 
by a contraction (see Chapter V, § 1, sec. 3) into an associated fraction. 


5. The conversion of orthogonal expansions into a sequence of 
approximating fractions 


A problem can be posed similar to that of converting the series 
Co , C1 , &e 
tga tas bes Pea em 


into a continued fraction 


Jodi td 
Q;X + Ay +AsX+..., 


namely, conversion of the series 
R(x) = a C;,0;(X), (4.67) 


where {w,(x)} is a system of functions orthogonal with respect to 
some weight in (a, 5), into a sequence of rational fractions of the form 


n-[F] 
Pa (x) _ » a;00;(x) 
Gn{x) [2] 
Dy b,w,{(x) 


(4.68) 


Here, in analogy with the conversion of power series into continued 
fractions the numbers a, and 5, are chosen so that the first n+ 1 terms 
of the expansion of the fraction (4.68) in an orthogonal system {w,(x)} 
coincide with the same terms in the series (4.67). The fraction (4.68) 
will also be termed in this case the n-th convergent. 
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The problem of finding such a convergent is not solvable in the 
general case. However, the problem has a solution for certain systems 
namely those satisfying the relationship 


Oy (x)@4(X) = AnOn41(%) + Byoy(x) + CyO,-1(*). (4.69) 


Numerous orthogonal systems satisfy (4.69), including in particular 
all orthogonal systems of polynomials, the system of trigonometric 
functions {cos nx}, of Bessel functions {/,(x)}, and so on. 

The formal process of converting the series (4.67) into the fraction 
(4.68) can be accomplished for these systems as follows. The fraction 
(4.68) is sought as the mth convergent of a continued fraction of the 
form 

Sq OX) +H, OX) +e OO (X) +4 . (4,70) 
1+ Bror(x)+r + v2 + 8.@ (xX) +73 +--- 


The requirement that the series (4.67) and the fraction (4.68) corres- 


pond can now be written as 


P(X) — 9n(x) x Cy, (x) = TP) On 41(X) a dP) Ona. 9(X) +... (4.71) 


Comparison of the coefficients of like functions w(x), ..., @,(x) 
in (4.71) leads to the following expressions for the coefficients «,, B,, 
y, (i =1,..., ) of continued fraction (4.70): | 


A= DC 
qa=1l, B=y=0, yo = B,, i 


ap 
By = Geet Baar tan Cn + Inde” 
" ago» | 
Bn Can ta Bn +d Anni tPBnde + nde? 


ty = — 


9 


din) 
(4,72) 
using these, we can find P,(x) and ¢,(x) from the recurrence relations 


Py (xX) == OpPy—1(x) + [01(%) + BalPn—2(*) + YnPn—s(*), 


4.73 
An(X) = Xn Gn—1(%) + [O1(*) + Balgn—2(*) + YnIn-a(>), 
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where we have put 


gr. = 9, q-, = 9, qo = 1, g;(x) =], 
P.=0, Py=C, Pyp=Cy Pix) = Cot Co,(x) 


(here, A,, B,, C,, are the coefficients of relationship (4.69)). 

To obtain rational approximations of sufficiently rapid convergence 
by this method, an effective approach is often to employ expansions 
in an orthogonal system of Chebyshev polynomials of the first kind 
(see § 4, sec. 7). 


6. Orthogonal polynomials and quadrature formulae of the 
Gaussian type 


The formula 


| ” f(s) do(x) = ALF a$0 (4.74) 


for approximate evaluation of the definite integral is called a quad- 
rature formula of the Gaussian type if the base-points x\” (i = 1, 
.., n) and coefficients A\™ (i = 1, 2, ..., m) are chosen so that 
(4.74) is accurate when f(x)is any polynomial of degree not exceed- 
ing 2n—1. 
THEOREM 17. If (4.74) is a quadrature formula of the Gaussian type, 
accurate for polynomials of degree not exceeding 2n—1, its base-points 


xi), x) ated 


are the n roots of the polynomial P,(x) of the system of polynomials 
orthogonal in (a, b) with respect to the weight o(x), while the coeffi- 
cients A\™ are the coefficients in the expansion of the n-th convergent 
R,-1(x)/P,,(x) of the continued fraction (4.62) into a sum of simple 
fractions 


Rn—1() = “ A‘) l 2 
P,,(x) 1 0 x+xfr) 
1.é. 


Asm) = Ra- Mx) (4.75) 
Prax) | 
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Alternatively, (4.75) can be written as 


rae te Py (t) do(t) 
a (t— x\™)Pr(t) 


In the particular case do(x) = dx and [a, 6] = [0, 1], (4.74) is 
the ordinary Gaussian quadrature formula, the base-points of which 
are the roots of the Legendre polynomial of degree n. 


7. The closure of an orthogonal system of polynomials 


The necessary and sufficient condition for closure of a system of 
polynomials {P,(x)}, orthogonal in (a, b) with respect to the weight 
o(x) in the space D3 (4, b), is that the problem of moments for 
the sequence of moments of the weight o(x) be determinate or that 
a(x) be its extremal solution (see ref. 7). 

The problem of moments for a finite segment {a, 5] is always 
determinate, so that orthogonal systems of polynomials with respect 
to any weight on a finite segment are closed. In particular, the sys- 
tems of Legendre, Chebyshev and Jacobi polynomials are closed 
(see § 4). 

The problems of moments are determinate for the Laguerre weight 
(see § 4, sec. 9) on (0, +), and for the Hermite weight (see § 4, 
sec. 4) on (—-, +), i.e. these systems of polynomials are closed. 

Hence the Fourier series in orthogonal polynomials of a function 
f(x) of L}.,, are convergent in the mean to this function in the case 
of all the classical weights. 

A discussion of the convergence of series in orthogonal polynomials 
{P,(x)} at every point and of the uniform convergence requires 
asymptotic estimates of |P,(x)| as 2 + o. 


8. Christoffel’s formula. The convergence of Fourier series in 
orthogonal polynomials 


Let {P_(x)} be an orthonormal system of polynomials in (a, 5) 
with respect to the weight o(x), and let f(x) be any function of the 
space L?,..(a, 0). 
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Let us write s, for the mth partial sum of the Fourier series of 
J(x) with respect to the system {P,(x)}: 


eG) = 7 C,P, (x). (4.76) 


If we make use of the expressions for the Fourier coefficients, 
s(x) can be written as 


S,(x) = | S(t) (3, POPC) do(t). (4.77) 
The expression : 
Kalt, 2) = ¥ POP) (4.78) 


is called the kernel of the integral (4.77). The following formula holds 
for the kernel: 

K, Kt, x) _ Tonys OE) — Fann) : (4.79) 
where A,,,, is given by (4.54). Formula (4.79), obtained by Christoffel 
for the casea = —1,b = +1, do(x) = dx, and generalized by Darboux 
to the case of any weight, is known as the Christoffel-Darboux 


formula. 
Formula (4.77) and the relationship 


| ° Kt, x) do(x) = 1 


lead to a formula for the remainder of the Fourier series of f(x) 
in the system {P,(x)}: 


b 
Sn(x) —f(x) = Vana | x(t) [Pro r(t)Pr(x) — Png i(X)Pa(t)] dots), 
‘ (4.80) 
where 


) = f= Fe) 


Pall nee 


The next two theorems, on the convergence of the Fourier series 
of f(x), follow from (4.80). 
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THEOREM 18. If all the polynomials P,(x) are bounded at the point 
x and the function o,{t) belongs to Dee (a, b), the Fourier series 


> CrP a(x) 
h=0 
is convergent at x and 


fx) = ¥ C,P,(2). 
k=0 


DEFINITION. The sequence of functions 9,(x), (x), .-+s P(X), 

. is said to be uniformly bounded if there exists a constant M such 
that | p,(x) |< M for all the functions of the system. 

THEOREM 19. Jf the polynomials P,(x) are uniformly bounded on 
(a, b), given any function f(x), integrable on (a, b) with respect to 
the weight o(x), its Fourier series in the system {P,(x)} is convergent 
to the value f(x) at every point x for which 


| ” p(t) dott) 


exists. 

The following theorems establish the convergence of the Fourier 
series of f(x) in an orthogonal system of polynomials {P,(x)}, having 
regard to the structural properties of f(x) instead of the properties 
of the system. 

THEOREM 20. If f(x) satisfies the Lipschitz condition with index 
o>, 

Z 
| f(%2) —f(%p) | < M | x2.- 11%, 


then the Fourier series of f(x) in a system of orthogonal polynomials 
{P,,(x)} is convergent almost everywhere on (a, b). 


b 
DEFINITION. The function L,(x) -| | K(t, x)| do(t) is known 
a 


as the Lebesque function of the orthonormal system {P _(x)}. 
THEOREM 21. Let f(x) be continuous and let its best approximation 
by polynomials of degree n 


E,(f) = inf max |f(x)—Q,(x)| 
Qu(x) (a, b) 
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satisfy the relationship 
L (Xo) -E,(f) + 0 as Nn o, 


Then the Fourier series of f(x) in the orthogonal system {P,(x)} is 
convergent, at X = Xo, to the value f(x,). 


§ 4. Classical systems of orthogonal polynomials 


1. Pearson’s differential equation 


The equation 


Q" Xo + XX ox(x) 
= = 4.81) 
0 eee al 
is known as Pearson’s equation. Solutions of the equation are called 
Pearson functions. The equation was introduced by Pearson for rep- 


resenting empirical laws of distribution. When a, = —1, a) = 0, 


~s+ x2 
Bo = 1, B, = B. = 0, the solution is the classical function e ? 
— the density of a normal distribution law. 
The weights of all the most important systems of orthogonal poly- 
nomials are Pearson functions. 
Jacobi’s weight is 


o(x) = (1~ x)*(14+-x)", (4.82) 


where A > —1, uw > —1; o(x) is defined on [—1, 1] and all its 
moments exist there. Pearson’s equation for Jacobi’s weight is 


(u—A)—(u+A)x . 


a 
0 1—x? 


(4.83) 


Chebyshev’s weight is a particular case of that of Jacobi, corres- 


1 ] 
ding toA = —— =——; 


o(x) = (4.84) 


1 
JI—x? 


ORTHOGONAL SERIES AND ORTHOGONAL SYSTEMS 211 


Pearson’s differential equation for Chebyshev’s weight is 


: x 
. = 5. (4.85) 


Legendre’s weight 0(x) ==1 is a particular case of that of Jacobi, 
corresponding to 4 = 0, uw = 0. Pearson’s equation for it is 


i 
* =. (4.86) 


Any Pearson function, having all moments, and for which the 
denominator (x) in (4.81) has real distinct roots, is reducible to any 
of the above functions by means of a linear change of the independ- 
ent variable. 

When the denominator A(x) has multiple or complex roots, the 
Pearson functions may not be weights of an orthogonal system of 
polynomials, since not all moments exist on the interval on which 
they are defined. 

The Chebyshev—Laguerre weight: 


o(x) = x*e“#*, where A> —1, wu > 0, (4.87) 
is defined on (0, + oo). Pearson’s equation for the Chebyshev—Laguerre 
weight is 
A— pu 

x 


ot 


Q 
; (4.88) 
Any Pearson function, having all moments on (0, + ~), for which 
the denominator B(x) in (4.81) is a polynomial of the first degree 
(B, = 0), is reducible to this function by means of a linear change 
of the independent variable. 
The Chebyshev—Hermite weight: 


o(x) = e™ (4.89) 
is defined on (— ~, +), Pearson’s equation becomes 

Oe sey 

Q 


Any Pearson function, having all moments on (—~, +), for 


which £(x) = const. in (4.81) (8, = 8, = 0), is reducible to a Cheby- 
shev-Hermite function. 
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Thus all the Pearson functions that can serve as weights of an 
orthogonal system of polynomials are reducible to one of the above 
basic weights. 


2. The differential equations for corresponding classes of 
orthogonal polynomials 


The polynomials of orthogonal systems whose weights are Pearson 
functions satisfy linear differential equations of the second order, 
to which various physical problems often reduce — a fact that ensures 
their importance in applied mathematics. 

If the weight o(x) of an orthogonal system of polynomials satis- 
fies 

—_ Ky +a,x 
@ Bo +Byx+ Bx’ 


then the mth degree polynomial of this system satisfies the differen- 
tial equation 


B(x)y" + [a(x) + B’@)y'— yay = 0, (4.90) 


where y, = n[a,+(n+1)f,], and a(x), B(x) are as in (4.81). 
EXAMPLE 15, For Chebyshev’s weight, 


a(x) = x, a, =1, 
B(x) =1-x, B= —1. 

The equation for Chebyshev polynomials is of the form 
(1—x?)y"” — xy’ +n’y = 0. 


3. The expression, by means of the weight, of a polynomial] of the 
nth degree belonging to an orthogonal system of polynomials 


Let us consider an orthogonal polynomial system with Pearson’s 
weight o(x) from (4.81). Let P,(x) be the mth degree polynomial of 
the system, orthogonal with respect to the weight function 0(*). 
We can write P,(x) in the form 


Pr (3) = Anes $5 {O00B"A)}. (4.91) 
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The formula was obtained by Rodrigues for Legendre polynomials 
(in 1814), while similar formulae were later obtained for other poly- 
nomials. Rodrigues’ formula was first published in the general 
form (4.91) in ref. 5. 

If A, = 1, the coefficient of the highest term in P,(x) is 


2n 
Q,= [] (+A), (4.92) 
hk=n+1 
while for x"! it is 
~ A np, ~ 
b, = RSEYY:E + Inky Nn. (4.93) 


The coefficient of the highest term in the normalized polynomial 


1S 
qo = ee So) (4.94) 
a) 0{x)B"(x) dx 


4. The generating function of an orthogonal system of 
polynomials with Pearson’s weight 


Let us take an orthogonal polynomial system {P,,(x)}, where P,,(x) 
is defined by (4.91) with constant 4, = 1. 

The generating function of the system is the function »(z, w) of two 
complex variables z and w such that 


yz, w) = ¥ fn) Ww, (4.95) 


THEOREM 22. Given any orthogonal system of polynomials {P_(x)} 
with weight function 0(x), satisfying condition (4.81), there exists a 
generating function (4.95), which is given by 


I o(fw) 


y(z, w) = o(z) T— whew)’ (4.96) 


where &., is the root of the quadratic equation 
&—z—wB(E) = 0 (4.97) 


that is close to z for small w. 
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EXAMPLE 16, Let us find the generating function for the Legendre 
polynomials. 
Equation (4.97) becomes in this case 


wi 1 E&—(z+w) = 0, 
where 


] 
by = =e = + 4wz +4?) 


is chosen in such a way that €,, is close to z for small w, i.e. 


] 
= ee cont e 
é., aa 1+./1+4wz + 4?) 


On applying formula (4.96) and putting o(x) = 1, we get 


l 


<5 4.98 
< 1+4wz+4w? mee) 


y(Z, yw) = 


The derivatives of polynomials orthogonal with respect to Pearson’s 
weight are also orthogonal polynomials with respect to the weight 


_ a(x) + B(x) 
0,(x) = exp | Bex) dx : 


5. Legendre polynomials 


The first system of orthogonal polynomials was historically the 
system of polynomials with the weight function o(x) = 1 on [-1, 
+1], introduced by Legendre in 1785. 

We introduce the following notation: let L,(x) be the Legendre 
polynomial, in which we have not fixed the factor, to an accuracy 


of which the system of orthogonal polynomials is defined, let L(x) 
be the mth degree polynomial with highest coefficient equal to 1, 
and let L(x) be the normalized Legendre polynomial. 

Rodrigues’ formula 1s 


L,(x) = Ay at (4.99) 


5 ade 
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Formulae (4.92)—-(4.94) lead to the expressions for L(x) and L(x:) 
d” 


2 
L(x) = = dx” =z (x*- 1)" ? (4.100) 
~ 2n+1 1 
LX) = e 2 Gnit < Gas 1)". (4.101) 
The explicit expression for a Legendre polynomial 1s 
ae ee (- 16 ila aS Chx-2h, (4.102) 


It follows from (4.102) that L(x) is an even function in x when n 
is even, and odd when n is odd. 
A recurrence formula. For the Legendre polynomials, we have 
in (4.54): 
_ _ (a+ 1)? 
CECT) 


si! a 2 —_ 
Enao(X) = XLna4(X)— aan L,,(x). (4.103) 


Obviously, L(x) = 1, Lx) = x; we further obtain from (4.103): 
L(x) = = Gxt 1), 
T(x) = = (Sx*—32), 
L,(x) = ; (35x4— 30x? +3), 


L(x) = = (315x5— 350x3+75x) and so on. 


3G 


The continued fraction (4.62) for a Legendre polynomial becomes 


Lo __ (+l 
Bo i SPE) abd) 
x Xx x x x 


The denominator of the nth convergent of (4.104) is L, (x). 
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The continued fraction (4.104) is convergent to In(x+1)/(x—1) 
at every point x lying outside [—1, +1]. 

The generating function. Let H(x, w)be the generating function of 
the Legendre polynomials (4.95); (4.98) now gives 


1 


A(x, v) = ——_—_—— _.,, 4.105 
oon Jl +4wx +40 ve 
and 
ee = FLO) yp 
J+ 40x+402 n=o0 n! 
where 
LoS 8-1, 
or 


H(x, w) = 1—2xw+2(3x?- Iw? — 4(5x8 — 3x)w + 
+ 2(35x4 — 30x? + 3)wt+ 


The generating function of the Legendre polynomials is often 
written in the form 


A(x, t) = eae see Where t= —2w, 


f/1—2xt+ 17 


so that 


k 
i = dh RODE, 


where /,(x) is given by (4.99) with A, = 1/(2k)!}. 
The polynomials Z,(x) and L,(x) are expressed as follows in terms 
of 1,(x): 


= ! 
Li) = ayy ns 


L(x) = jae 1,(*). 


The polynomials /,(x) satisfy the recurrence formula 


(n + 2)Inao(X) = (2n + 3)XIp a(x) —(n + Dlp(x). (4.107) 


(4.106) 
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The differential equation for Legendre polynomials is 
(1—x*)p" —2xy’+n(n + Dy = 0. 


The integral form of Legendre polynomials. The polynomial 
I(x) = (2n)tt 7 ae nr 0a 1)" 


can be written in the form 


L(x) = ty (x+i/1—x? cos p)" dp (4.108) 


The integral in (4:108) is known as a Laplace integral (it has a real 
value for real x, in spite of the integrand being complex). The poly- 
nomials /,(x) are uniformly bounded on the segment of orthogonality 
[—1, +1). 

It follows from (4.108) that 


[2,(x)| = 1 (4.109) 
for 
lx{ sl. 


A stricter inequality holds for points lying inside the interval 


(—1, +1): 
[a Ls 
[/.(x)| 3 > Fan (4.110) 


T(x) = Ina lng 1X) = 0 


forn21, -lsxZl. 
The following are expansions of certain functions in Legendre 
polynomials: 


Turan’s inequality is 


an 
x ~ In sq - 


2n(2n— 2)... (2n—2k +2) 


+X Gk+D Gitta 3).. Gn tak $y 28) 


N 
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3 
ant] — 
x =e 5 A&M) + 


= | 2n(2n— 2)... (2n—2k +2) 
+ 2 Gk +3) G3) Gna 5)... Gn pak aay 21s 
1 nm & (2k— 111)? 
== 4k 1 art a aaa l 9 I, 
Jee te 4 2k! a 
x = - (2kK—1)!! (Qk +1)!! 
Fins srg (4k + 3) SEE B® |x| <1. 
—S 2. = (2k —3)!!(2k—1)!! 
Jl—x? = ie py k+l) Sorrigte ed! ha(o) f 


lx| <1, 


arcsin x = 5 >, (Sa ) Uon41(%)— lan_r()], |x| < 1. 


The convergence of Fourier series in Legendre polynomials. 

THEOREM 23. If f(x) has a continuous second derivative in [—1, +1], 
it can be expanded as a uniformly convergent series in Legendre poly- 
nomials in [~1, +1]. 

By (4.106) and (4.109), we have the following inequality for nor- 
malized Legendre polynomials: 


Le < (a for |x| 31. (4.111) 


Formula (4.111) and the corresponding inequality for the kernel 


K,(t, x) of L, (x) give an inequality for the Lebesgue function (see 
§ 3, sec. 8): 


L,(x) = (n+ 1). (4.112) 
A consequence of Theorem 21 (see § 3, sec. 8) and (4.112) is: 
THEOREM 24. Every continuous function f(x), the best approximation 
of which satisfies the condition 


lim 7°E,(f) = 0 (4.113) 
N-> co 


can be expanded as a uniformly convergent series in [—1, +1] in 
Legendre polynomials. 

The following is a consequence of Theorem 23 and formulae (4.106) 
and (4.110): 
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THEOREM 25. A function f(x), the square of which is integrable in 
[—1, 1], can be expanded as a Fourier series in Legendre polynomials 
convergent to f(x) at every point x for which the integral exists: 


f (M=f2Y a. at4 
-1 


x 


REMARK. Condition (4.114) is satisfied, in particular, if the finite 
derivative f’(x) exists at the point x. 

THEOREM 26. Let f(x) be a function, the square of which is integrable 
in [—1, 1], and suppose the left- and right-hand limits f(x—0) and 
f(x—0) exist at the point x In this case, if the integrals 


f (f0=fe= OY a f (ery : 
= t—x e t—x 


are finite, the Fourier series in Legendre polynomials is convergent 
at the point x t= [f(x—0)+f(*+0)] 
THEOREM 27. If f(x) satisfies the Dini-Lipschitz condition in {—1, 
+1): 
lim w(6) In (6) = 0 
$’—>0 


(where w(6)= sup {[f(x)—Cf(%2)|} is the oscillation of 
| xp—xe| <3 
S(x)), it can be expanded at every point of the interval as a Fourier 


series in Legendre polynomials, the convergence being uniform in every 
segment [-1+h, 1—h] (h>0). 


6. Jacobi polynomials 


The Jacobi polynomials are polynomials orthogonal in [—1, +1] 
with respect to the weight 


a(x) = (L—x (14-94, (4.115) 


where A> —1, uw>—1. The weight function (4.115) is Pearson’s 
weight (see § 4, sec. 1). The above definition specifies the Jacobi 
polynomials apart from a constant factor. If this factor is not fixed, 
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we shall denote the polynomials by J "(x); we write JO #) (x) 
if the coefficient of x" is unity, and J (x) if the polynomial is 
normalized. 

The Legendre polynomials (see sec. 5) are a particular case of 


Jacobi polynomials, with A= y=0. The case A= p= =and 
A=uz -z are specially treated later (see sec. 7, 8). The poly- 


nomials corresponding to these values of A and yu are called Chebyshev 
polynomials (of the second and first kind respectively). 

In general, the case A = uw has certain special features. The Jacobi 
polynomials with A = yu are said to be ultraspherical. 

Rodrigues’ formula. Formula (4.91) gives for Jacobi polynomials: 


JOO) = AL +3)-* Saye], (4.116) 


where we have for J ")(x): 


PA+p+n+1) 
herman = 1 Sg Seve DA ea aS 
sa oa L(A+pmt+2n+1)’ irae 


and for Jn Hx): 


Aehore n-tptoneyl Aternt+ DT Ate+2nt 1) . 
Fe F(A+n4+1)2(Qu+n+1)n! 
(4.118) 
These formulae are suitable for » > 0. They are also true for n = 0, 


provided A+u+1 +0; if At+u+1=0, they lose their meaning 
at m = 0, though it is clear that 


J ex) = 1. 


An explicit expression. If A, =(—1)"/2"n! in Rodrigues’ formula 
(4.116), we shall write j"(x) for the corresponding Jacobi poly- 
nomial. It is often convenient to discuss this Jacobi polynomial. 
For it, the following formula holds: 


iQ) = 


l PAtn+i1)Fu4n+)) 


n 
= Rt ey Ns ee —_ 1\n—k k 
= mani 2" Fan ks Drutkey © e+. 


(4.119) 
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A recurrence relation. The general recurrence relation (4.54) for three 
consecutive polynomials of a system. of orthogonal polynomials 
becomes, in the case of the system of Jacobi polynomials; 


ION x) = (xen ye) TREX) — Ang J), (4.120) 


where 
pe— 
ins2 = Tp d int DAtESInGA) ’ 
ing ee ae 
TE Atptant NA+ eu +2042? Ate +2n+3) | 
(4.121) 
Since 


an = A—p 
J 1 and J} x Fao" 


all the Jacobi polynomials can be obtained successively from (4.120). 
These expressions are very unwieldy, however; e.g. 


7 A-p (A-uP+A+w—4 
(A, 2) = x2 
gM) ea Sees) ae 


and so on. The explicit formula (4.119) is more practical for their 
actual computation. Complete tables of Jacobi polynomials are 
available (see ref. 3). The Jacobi polynomials satisfy recurrence rela- 
tions, not only with respect to the parameter 7, but also with respect 
to the parameters 4 and n, A, uw and n, these being consequences of 
Gauss’s formulae for the hypergeometric functions; the Jacobi 
polynomials are a particular case of the latter. 

The generating function. Let J(x, w) be the generating function of 
the Jacobi polynomials (see sec. 4). Formula (4.96) now gives 
I(x, w) = at (1 +.2w + fl + 4wx +4w2)—* > 


J 1+4xw-+ 4? 
x (1—-2wt./1+4wx+4w2)7* = (4.122) 
= J) on 


I(x, w= > os (4.123) 
n=0 ‘ ; 


and 
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where 


Je) = (L—x)-*(1+x)7# (1 —x)@*+™) (14 x)8+"], (4.124) 
The generating function for the Jacobi polynomials is often 
written in the form 
DAat+h ———_——_———.,_} 

(1 — 14+ 1 —2xt+ 17)" X 
J1—2xt+? ( v 
X(141+J1—2xt4+ 22)", (4.125) 

where t = —2w; the coefficients of the expansion in powers of ¢ 
are now the polynomials j\ (x) (see (4.119)). In the case of ultra- 
spherical polynomials (A = yu), the generating function is simplified 
if we introduce, instead of polynomials j( (x), the polynomials 


I(x, th = 


r(a+t)rnt20 \ 
vinx) = —————~- jn (x), where a = 4+ 5, 
in fact, 
(1— 2x $22)-* = Syne, (4.126) 
na=0 


By using the ultraspherical polynomials 72, N. Ya. Sonin obtained 
an analogue of Taylor’s formula: 


oo a (v)/; 
flr+a) = 21) F (nv) Beg OP) ay, (4.127) 


where J,(«) is Bessel’s function, D = d/dx. 

A differential equation for Jacobi polynomials. Differential equation 
(4.90) for polynomials orthogonal with respect to Pearson’s weight 
function, becomes, in the case of Jacobi polynomials: 


(1 — x*)y" + [(u— A) — (Ut A42)x]y' ++ ptns+ ly = 0. (4.128) 


Inequalities for Jacobi polynomials and the convergence of the 
Fourier series. Given the condition 
I 


o = max {A, uw} = =o (4.129) 


the following theorems hold. 
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THEOREM 28. The greatest value of the modulus of J\”(x) is 
attained in the segment [—1, 1] at one of the points x = +1. 

THEOREM 29. Given condition (4.129), the normalized Jacobi poly- 
nomials satisfy the relationship 


: ott 
JJ (x) |< Mn ? 
for all |x| S1. 
Here M is a constant, depending on A and u. 
It follows from Theorem 29 that the Lebesgue function of the 
Jacobi polynomials satisfies 


L(x) = M,neet2, 
which leads, in conjunction with Theorem 21 (see § 3), to 
THEOREM 30. Let og = “5 and let p be a positive integer not 


less than 20+-2. Every function f(x), defined in [—1, 1] and having 
a continuous derivative of order p, can be expanded as a uniformily 


convergent Fourier series in the polynomials J (x). 


7. Chebyshev polynomials of the first kind 


Chebyshev polynomials of the first kind are a particular case of 
1 


Jacobi polynomials (see § 4, sec. 6), corresponding to A = bp = -> 


i. 2 

The polynomials hom = were first discussed by P.L. Cheby- 
shev in 1857, when solving the problem of the best approximation 
of continuous functions by polynomials. We shall denote them by 
T,(x); these polynomials were obtained by Chebyshev in the form 


T,(x) = cos (m arc cos x). (4.130) 


Formula (4.130) defines 7,,(x) only on the segment [—1, 1]. But 
definition (4.130) can be extended to all values of x by means of the 
familiar trigonometric formula. 


cos np = cos" p— C2 cos"=* 9 sin? p+ C4 cos"—4 p sint p— ... 


(this completion of definition (4.130) will be assumed without making 
any special proviso in future). 
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The polynomials 7,(x) possess many remarkable so-called extremal 
properties in addition to their general properties as polynomials of 
an orthogonal system; these extremal properties will be described 
after dealing with the general properties. 

Rodrigues’ formula is 


d” 1 n 
T,(x) = A, /1— x? — : 4.131 
aan (7s) fom 
We shall write T,(x) for the polynomial with highest coefficient 
equal to unity, and 7,(x) for the normalized polynomial. 
An explicit expression. Formula (4.130) yields an explicit expression 
for the Chebyshev polynomials, where 


T,(x) = = cos (n arc Cos x), 
5 (4.132) 
T,(x) = aE cos (marc cos x). 
Expression (4.130) can also be written in the form 
] 
T(x) = > [Cet V?= 1)" + (x— V2? = 1)" 
sia (4.133) 


n 
2 n 
ss — 1\k __ ork n—2k—1yn—-2k 
T(2) = (— DB ay Chancho, 
As follows from (4.130), the zeros of T,,(x) are the numbers 


x) = cos EO (kK=1,2,..., 7). (4.134) 


The recurrence formulae 


T(x) = 2xT,_, (4) — Tn-2 @), (4.135) 
T(x) = xTy)-GTn-2 0) (4.136) 


follow from (4.120) with 2 = u = -> . Since Jo(x) = 1, 7,(x) = x, 


it follows from the equation (4.135) that 


ORTHOGONAL SERIES AND ORTHOGONAL SYSTEMS 225 


T, (x) = 2x*-1, 

T;( x) = 4x3 — 3x, 

T,( x) = 8x*—8x?+1, 

T; (x) = 16x — 20x? + 5x, 

T, (x) = 32x58 — 48x4 + 18x7+ 1 
and so on. 


In the case of Chebyshev polynomials, the continued fraction 
(4.62) becomes 


1 oil 
Oy ee ee, (4.137) 
x—-x—-x-x- ‘ 
since here, 
== 2. js : d; = 0 
aVJl-# 4 


The denominator of the mth convergent of the continued fraction 
(4.137) is T(x). The continued fraction is convergent, for all x 
outside the interval (—1, 1), to the function f/x? 1. 

The generating function. The coefficient of t" in the expansion of 


|— 1? 


T(x, t) = rer (4.138) 
in powers of ¢ is the polynomial 7,(x): 
T(x, t) = a = Ty +2 3 Ty (xr 
= 21x +t nel 
The differential equation for Chebyshev polynomials is 
(l—x*)y"’ —xy’+ ry = 0. (4.139) 


Expansion of a function as a Fourier series in Chebyshev polynomials 
and the comparison of this with the expansion as a Maclaurin series. 
Wide use is made of Fourier series in Chebyshev polynomials 7,(x) 
for uniform approximation of functions. Notice that the expansion 
of a function f(x) in [—1, 1] as a Fourier series in polynomials 7,(x) 
reduces to the expansion of f(cos x) in [—2, 2] as a Fourier series 
in cosines. 
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For instance, 


et Coe = T(a)+2 y I,(a) cos ng, 
n=l 


where J,(a) is Bessel’s function; hence the substitution x = cos » 
gives 


emt = J,(a) +2 y Ip(a) Ty (x). 


An expansion may similarly be obtained for f(x) = x” from the 
familiar trigonometric formulae: 


n-l1 
cost? 9 = a ( 2 2Ck, cos 2(n—k)p+ Ch ; 


re 


1 
cos?"-1q = geet 2 Ck _, cos (2n—2k— 1). 


The substitution x = cos@ gives 
l n=1 h 
xe = Ran (; ; 2ChTan-m20)+ Ch ’ | 
| (4.140) 


] "el 
xml = gre 2 Chn~11 on—2h-1(%)- 


Similarly, expansions in Chebyshev polynomials T. n(x) follow from 
the expansions in cosines (with |x| < 1): 


2, 4 SF Tar) 
l= ata oy ae" eure 
: 42 Ye 
sign x = ae pyres Zann) | (4.142) 


cos ax = J,(a)+2 : (—1)"Jon(2)Tan (*), (4.143) 


sin ax = 2 F(—1)"* Man i(@)Tan-1 (2) (4144) 
arcsinx = => (—1)"*1 os ~ (4.145) 
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em = Ia) +2 In(@)Ta(%), (4.146) 
nai 


In(l—2gx+q%) = -2F OT @) (lgi< 0. (147 


In general, if C, is the Fourier coefficient of f(cos x) in the system 
{cos np}, we have 


Gia | * Heap eoomapa | * f(T y() 
Jog | 


dx 
es (4.148) | 

Roughly speaking, when such functions are represented by the sum 
of a like number of terms, the limits of the accuracy are 2"~/ times 
better for an expansion in Chebyshev polynomials than for a Taylor 
series. 

For example, when |x| = 1 follows from (4.146) that, in the case 
of f(x) = e™ with large n, 


qnt2 q” 
C. = 2h(@) ~ 2| sa aereat + |* ager 


while at the same time 


If we substitute the Maclaurin series for f(x) 


” (n) 
fe) = flo) f(x +L ” wt... —® xn 


eaoegy 


under the integral sign in (4.148), in view of the orthogonality of 

the polynomials 7,(x) and the expressions (4.138), (4.140), we get 

an interesting connection between the coefficient C,, in the expansion 

of f(x) in Chebyshev polynomials and the corresponding coefficient 
of Maclaurin’s formula for f(x), viz 

f™(O) f +20) fn+4n(o) 

arp >( a! *(a+2lil raat 7) GNM) 

It follows from (4.149) that, ifthe principal part of f™(O0)/n! +...) 

reduces to f‘"(0)/n! for large n, we have 

1 f™O0) 

eae 2 nt” 


(4.150) 
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It follows from (4.150) that, given |x| < 7 the expansion of a 
function as a Maclaurin series 1s in general better, whereas the expan- 


sion in Chebyshev polynomials is better for -< [x|< 1, since 


max | C,7,(x)| = Cn a < max PO) an 
> <|x1#2 


The convergence of Fourier series in Chebyshev polynomials. In view 
of the fact that 
[7,(x)| = 1, 


it follows from Theorem 19 § 3 that: 

THEOREM 31. Given any function f(x), integrable in (—1, 1) with 
respect to the weight 1/./1—x?, its Fourier series in the system {T,(x)} 
is convergent to the value f(x) at every point x for which the integral 


am —f(t) dt | 
—t? J1—#? ~ J1—-# 


exists. The Lebesgue function of the system of Chebyshev polyno- 
mials satisfies the inequality 


L(x) = 24+1nn. 


We therefore have (see Theorem 23 § 3): 
THEOREM 32. Every function f(x) for which 


lim £,(f) Inn = Q, 
TN —} oo 


can be expanded as a uniformly convergent series in Chebyshev poly- 
nomials. 

The extremal properties of Chebyshev polynomials. 

THEOREM 33 (Chebyshev). Of all the polynomials with highest 
coefficient equal to unity, the polynomial T,,(x) has the least deviation 
from zero, i.e. 

max |7,(x)|< max |Q,(x)| 
=—1 S251 -1=x=1 
Jor all polynomials Q(x) of degree n, having highest coefficient equal 
to unity. 
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COROLLARY. Since 


— 1 
max | 7; (x) | = an-1? 
1 


-1Sx= 
we have for any polynomial Q(x) with highest coefficient equal to unity: 


l 
max |Q,(x)| > =I" 
1 


-li=s= 


The following interpolation property of the zeros of a Chebyshev 
polynomial is a consequence of the theorem. Suppose we form, with 
respect to the points x,, X,, ..., x, an interpolation polynomial 
Q,-,(x) of degree n—1 for a function f(x), n times differentiable 
in [—l, 1]. The remainder term of the accurate interpolation is 
now given by 


Ry (x) = f(X) — Qn) = 


where 


f'™) 


n! 


(x— x1) (x -—X)...(X— Xp), 


Xi< Xin, and E&€ (x, xp). 


If the interpolation base-points x1, Xo, ..., x, are zeros of the Cheby- 
shev polynomial 7,(x), then 


max |(x—x,)(*—X,)...(*—X,)| 
x€{—1, 1) 


has a minimum value. 

Thus, if the coefficient of f‘(&) in (4.148) changes only a little in 
relation to the variation of x in (—1, 1), the interpolation base-points 
which are roots of the polynomial 7,,(x), yield the least value of the 
remainder term. 

THEOREM 34 (Chebyshev). Of all the polynomials Q(x), subject to 
the condition Q,(&) = M, where |&| < 1, the polynomial MT ,(x)/T,(&) 
deviates the least from zero in the segment [-—1, 1]. 

THEOREM 35 (A. A. Markov and V. A. Markov). Jf the polynomial 
Q(x) satisfies, in [—1, 1], the inequality 


|On(x)| = M, 
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the derivative of order k of this polyomial satisfies in [—1, 1] the 
inequality 
nn? —1)... [n?—(k—1)7] 


|On'(x)| = M ——735—ET , 


(4.151) 


the sign of equality being obtained in (4.151) only for the polynomial 
T(x) at the points x = +1. 


8. Chebyshev polynomials of the second kind 


The polynomials of the second kind with respect to the weight 


1//1—x? (see § 3, sec. 4), ie. the numerators of the convergents of 
the continued fraction (4.137), form an orthogonal system in [—1, 


1] with respect to the weight o(x) = /1—x? and are therefore the 
Jacobi polynomials corresponding to A= p= - They are known 


as Chebyshev polynomials of the second kind. We shall denote them 
by U,,(x). . 

The Chebyshev polynomials U,(x) and 7,,,(x) are connected 
by the relationship 


U,(x) = C,, £ Tn41(X). (4.152) 


An explicit expression for the polynomials. We have from (4.152): 


sin [((n+ 1) arccos x] 


/1—x? 


Formula (4.153) defines U,(x) only in the interval (—1, 1), but this 
definition may be extended to all x by means of the familiar trigono- 
metric identity 


U,(x) = Cp (4.153) 


sin(n + 1)p = sin®*? p— CZ, sin"~1 pcos’? p+ 
+C4,,sin"-3 ocos‘o— .... 


In U.(x), let the coefficient of x" be unity, while {|U,|| = 1. 
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Now, 
sin [(7+ 1) arccos x] | 


J1l—-x? 


U(x) = jz eo (4.155) 


T(x) = = (4.154) 


Recurrence formula. As the numerators of continued fraction (4.137), 
the polynomials U,,(x) satisfy the same recurrence relation as T,, , ,(x): 


Tnsa() = Tne Tal, 


where U(x) =. U,(x) = x; hence 


Tx) = 8-3, 


— I 
U,(x) = — 5%; 


— 3 l 
U,(x) = x8— Twat TE and so on. 

A continued fraction for polynomials U,(x). These polynomials 
form an orthogonal system with respect to the weight o(x) = yi 1—x? 
and are in turn the denominators of the mth convergent of the conti- 
nued fraction 


ee (4.156) 


we 


p= hal) JHae while = 2 (a ee eee 


The numerators of the mth convergents of the continued fraction (4.156) 


are U,,_4(x)- For all x lying outside the segment [—1, +1], the con- 
tinued fraction is convergent to the function 


f(x) = (x— J? = 1a. 
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Fourier series in Chebyshev polynomials U,(x). The following 
inequalities hold: 


,01< [Eon (-lsxs 1), 

; zs (4.157) 
[0,001 = [= as (-l<x< 1), 

The next theorems are consequences of (4.157) and the general 
theorems (see § 3, sec. 5). 

THEOREM 36. Every function, having a continuous derivative of the 
third order, can be expanded as a uniformly convergent series in poly- 
nomials U,(x). 

THEOREM 37. Every function f(x) of Lyz—z(—1,1) can be expanded 
as a Fourier series in the orthogonal polynomials U_(x) at every point 
x, and for every f(x) the following integral exists: 


l (A= | Ji—?? dt. (4.158) 
=] = 


THEOREM 38, If a function f(x), defined on [—1, 1], satisfies the 
Dini-Lipschitz condition 


lim w(6) In 6 = 0, (4.159) 
é—>0 ; 
it can be expanded in the interval (—1, 1) as a Fourier series in poly- 
nomials U,(x), the convergence being uniform in any interval (—1+ 
+h, 1—hA). 


Given suitable convergence conditions, (4.152) enables us to diffe- 
rentiate the expansion 


fe) = Yan Tn 2) (4.160) 


term by term, to obtain the expansion 


FG) = ¥ ndgUn 10%) 
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Expansions (4.139 — 4.142) given above in polynomials 7,, lead to 
the following expansions in polynomials U,;: 


eat — 2 y nI,,(a) Un _1(x), 
Qa nel 


: — 4 BS 2nUgn_{ (x) 
sign x = ne ae a 


sin ax = = ¥ (—1)" 2nJaq(@)Uan—1(%), 


2 co 
COS @x = me 2 (-- 1)**1 (2n— 1) Jon—1(2) Uaun—1)(*) 
i= 


and so on. 


An extremal property of polynomials U,(x). 


THEOREM 39 (Chebyshev). Of all the polynomials Q(x) of degree 
n with highest coefficient equal to unity, the least value of the integral 


{ | On(x) | dx 
-1 


is given by Q,(x) = U,(x). 


9, Laguerre polynomials 


The polynomials orthogonal in the interval (0, + ©) with respect 
to the weight function o(x) = x*e~* (a > —1) are usually called 
Laguerre or Chebyshev—Laguerre polynomials. 


These polynomials were first encountered in the case « = 0 in 
the analytical mechanics of Lagrange, then in Abel’s posthumous 
papers. Chebyshev discussed the polynomials in 1859, and for them 
obtained a recurrence formula and an expansion as a continued 
fraction; it was only in 1878 that they were considered by Laguerre. 
The case of any «2 > —1 was first discussed by Sokhotskii. 

Some authors only speak of Laguerre polynomials in the case 
« =O, and refer to generalized Laguerre polynomials when « = 0. 
We shail denote the latter by L?(x). 
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Rodrigues’ formula is 


L(x) = Anx8e® So (ite=2) (4.161) 


The polynomial L(x) with highest coefficient equal to unity is 
obtained from (4.161) with A, =(-—1)", while the normalized 


L(x) is obtained with 
(— 1)” 
yg een! A 
J/niL(a+n+1) 


A recurrence formula: 
L*, (x) = (x—a—2n— 3) 2, ()—(n- I) (nta +1) Lax). (4.162) 
In the case « = 0 this reduces to 
Lnso(X) = (x—2n— 3) Lngi(x) — (n+ 1P L), 
from which we find, using L,(x) = 1, L(x) = x—1, 
L(x) = x*—4x+2, 
L(x) = x8 —9x?-418x—6, and so on. 


A continued fraction for polynomials L(x). In the case 2 = 0, the 
continued fraction (4.162), of which the denominator of the nth 


convergent is L_ (x), takes the form 


fe ee ee (4.163) 
x-1]l—x-3—x-5—x-T—.... 


The continued fraction (4.163) is convergent for all x not lying in 
(0, +0) to the function 


co pot 
F(x) =| say @: 


The continued fraction for any «, 


a+ a+] 2(a +2) 3(a + 3) 
x—(a+1l)—x—(@+3) —x—(@+5)—x—-(@+7)  ~— (4.164) 


is convergent for any x not lying in (0, + ©), to the function 
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A differential equation for L*(x): 


xy" +(a+1—x)y’+ny = 0. (4.165) 


Sokhotskii obtained a formula for the power x” in terms of Laguerre 
polynomials: , 
Li n(x) 


nr 
ic l =. 
. a ) LT —k+a+1) 
The generating function is 
xt ed _. 1] \rynzva 
dante FF FUER (4.166) 
n=O : 


Formula (4.166) was first obtained by Sokhotskii. The generating 
function can also be written in the form 
~pta(2ivtx) SLi" 
(i,/tx)* n=0 nilT(a+na+l) 


where /,(z) is Bessel’s function. Formula (4.167) was obtained by 
N.Ya. Sonin. Sonin also obtained the relationships 


(4.167) 


pa(t, x) = e 


1 dl S4i(%) _ ra, L(x) 
on ae ee 
n(n +a)L@ (x) oa AA) (4.168) 
xn qa x” . 
x 


Closure of the system {L*(x)}. The problem of moments for the 
sequence 


oo 
Un = | e*x "dx 
0 


1s determinate, from which it follows, by Riesz’s Theorem, (see § 3, 
sec. 7) that the system {L‘(x)} is closed in the space Le, a0, + ©). 
The Laguerre polynomials can be obtained from the Jacobi poly- 


nomials j") by means of a passage to the limit: 


L(x) = lim jo») € -%) (4.169) 


lL —> 00 


(K. A. Posset’s formula). 
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10. Hermite polynomials 


The polynomials, orthogonal on (— ©, + cc) with respect to the 


1 
weight o(x) =e ? = are known as Hermite polynomials. This 
name is Sometimes given to the polynomials orthogonal with respect 
to the weight e~**. Such polynomials are first encountered in Lap- 
lace’s works, then in those of Chebyshev (1859). Chebyshev obtained 
a Rodrigues’ formula and an expansion as a continued fraction. 
They were considered by Hermite five years after Chebyshev. Ro- 
drigues’ formula 1s 


xen ( 2 
H,,(x) = A,e? axt (. 2 } ; (4.170) 


when A, = (—1)” we get H._(x) — the polynomial with highest coef- 
ficient equal to unity; when A, = (—1)"/ J n\ J/2n we get the normal- 
ized H,,(x). 

The recurrence formula 1s 


Hyai(x) = xH,(x) —nH,-1(%); (4.171) 
since H,(x) — 1, Hix) = x, we get 
H,(x) = - I, 
H,(x) = »°— 3x, 


H,(x) = x*— 6x? +3, 
H,(x) = x®—10x3+15x, and so on. 


The generating function is 


oe eo n 
Foaaraee Py oy (4.172) 


The continued fraction (4.62), of which the denominator of the 
nth convergent 1s the polynomial H,(x), is 
vk 2S (4.173) 
X —~-X¥-XxX—-x-... 
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Fraction (4.173) is convergent for all non-real x to the function 


A differential equation for the Hermite polynomials: 
y’—xy’+ny = 0. (4.174) 


The polynomials H,(x) can also be obtained from the Jacobi 
polynomials j*(x) as A+ : 


H n(x) = ° -= (2, a) a 
0) = im [Eee(A)] ats 


Closure of the system of Hermite polynomials. The problem of mo- 
ments for the sequence 


‘oo x2 
Pn -| x"e 2 dx 


is determinate. Hence it follows by Riesz’s theorem (see § 3, sec. 7) 
that the system {H,(x)} is closed in the space L? , - (— 0, +), 
e ? 


11. Chebyshev polynomials, orthogonal on a finite 
system of points 


In a paper of 1855, “Continuous fractions” (O nepreryvnykh 
drobyakh), and in certain other works, Chebyshev considered the 
expansion of the sum 

A G?(x;) 


62(x;) = m 
4 z—-x;’ ( i) i 


as a continued fraction and investigated the properties of the denomin- 
ators of its convergents. 

If o(x) is a step function with growth points x), x2, ...,Xy, the jumps 
at which are equal to m,, mg, ..., My respectively, then 


NOH) | = do(x) (4.176) 


1 2-%; eo a 


238 MATHEMATICAL ANALYSIS 


The denominators of the convergents of the continued fraction (of 
type (4.62)), corresponding to integral (4.176), are now polynomials 
orthogonal with respect to the weight function o(x). 

The orthogonality of P,(x) and P,(x) with respect to o(x) implies 
in this case that 


F xDDD =0  s#k. 
im] 


The continued fraction (4.62) is now finite, the system of orthogonal 
polynomials is also finite and contains precisely N polynomials P,(x), 
P(x), ..., Py—,(x). Chebyshev applied the results of his investiga- 
tions to interpolation by the method of least squares which consists 
of the following. The values of the function f(x) are specified at the 
points x, X2, ..., Xy. Among all the polynomials of a given degree 
n< N, we have to find the polynomial @Q,(x) such that the sum 


Ye) Ona (4.17) 


is a minimum (see § 1, sec. 3). 
Let 6°(x,) = 1 in (4.176); then 


N = 
p> [f)—-Qn0)P = (f(x) — Qn(x))? do(x). 
= -©0 
And, as follows from § 2, sec. 4, (4.177) takes its least value when 
Q,(x) is the mth segment of the Fourier series of f(x) in a system of 
polynomials orthogonal with respect to the weight function o(x). 
Using a system of equidistant base points on the segment (0, 1]: 


“= (1s Ze ag NV): 


Chebyshev formed an orthogonal system of polynomials {6(x,)? = 1}. 
These are also known as Chebyshev polynomials. We shall denote 
them by P, ,(x) (the polynomial of degree k in the system {x,; = 


Py, h(x) = 1+4,X 4- Agx(x — 1) + agx(x— 1) (x—2)-++ ... 
wee $Q,xX(x-—1)...(x-—k +1), 
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where 
—1)°CRCh a1 
: =a .(n—st+l) 
In particular, 
Po, n(x) = I, 
P,, n(x) = 1-2 = > 


—1 
Pp, n(x) = 1-6 ees 7 
x(x— 90 x(x — 1) (x—2) 


1) 
P3, n(x) = 1-12 + 30 —_—_—- MN 1) MN 1) (N=2) ) 
) 


x x(x-—1 


MN-1) — 
0 DEED” RW SDO DO 
Ps, y(x) = 1-30 < +210 — 5 
so NED ay SNE D 


952 x(x — 1) (x— 2) (x— 3) (x~ 4) 
N(N — 1) (N—2)(N— 3) (N—4)’ 


and so on. The interpolation polynomial of degree m with respect 
to the system base points {x, = i/N} for f(x), defined by the method 
of least squares, is the segment of the Fourier series of f(x) of order 
m with respect to the system {P, ,(x)}: 


0,(x) = Pa CPx, w(x), 
where 


Ch = | JedPa, nO) dots) = J fledPavtad 


240 MATHEMATICAL ANALYSIS 


The expression for C, does not depend on the degree of interpo- 
lation m. On increasing the degree of the interpolation polynomial 
new terms are simply added: 


Om 43(X) = O,,(x) + Cm41Pm41, n(x). 


Chebyshev showed that the case when o(x) is continuous can be 
obtained by means of a passage to the limit from the case when 
o(x) has a finite number of growth points. 

In particular, the Legendre polynomials can be obtained from the 
polynomials P, (x) as N — o. If L,(x) is a Legendre polynomial, 
normalized by the condition that L,(1) = 1, we have 


L,(2x—1) = = im | (aot eee 


CHAPTER V 


CONTINUED FRACTIONS 


Introduction 


1. Notation for continued fractions. Basic definitions 


An expression of the form 


is called a continued fraction. 
In view of the unwieldiness of the above method of writing, several 
authors have proposed different methods, for instance: 


a,| ao ay | 3, : 

Di ee ea a aia a Pringsheim 

Se eae aa nee 
a: | Gn | Be 

a ca ee (Miller) 
a 4 an 

a es ae (Rogers) (5.1) 


We shall use the last notation. Pringsheim also proposed writing a 
continued fraction in the form [b); a,/b,]>. If a,, and 5, in frac- 
tion (5.1) follow a different law to the remaining a, and b,, Pringsheim 
used the notation [b 9; a,/b,, 9,/6,)>. 

The fraction a,,/b, 1s called the n-th partial quotient of the continued 
fraction (5.1); a, and 5, are the terms of the n-th partial quotient; 
Qi, Ag, @3,... are called the partial numerators of the continued 
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fraction; b,, by, bs ,... are its partial denominators; b, is called the 
zero partial quotient. | 

All the terms of the partial quotients will be assumed finite; all 
the partial denominators are usually assumed to be non-zero. 

A continued fraction having a finite set of partial quotients is 
described as terminating. 

A continued fraction having an infinite set of partial quotients 
is described as non-terminating. 


2. A brief historical note | 


Algorithms similar to continued fractions were employed even by the mathe- 


maticians of antiquity (Euclid’s algorithm, the Archimedean approximation to a 3). 
Of the médiaeval mathematicians, Omar Khayyam (c. 1040-1123) came close 
to continued fractions when trying to generalize Euclid’s algorithm to the case 
of incommensurable magnitudes, but continued fractions as such first appeared 
in the “Algebra” of the Italian mathematician R.Bombelli, published in 1572. 
A number of outstanding mathematicians of the seventeenth century, including 
J. Wallis and Chr. Huygens, occupied themselves with continued fractions, but 
the founder of the theory of continued fractions as an independent branch of 
mathematics was Euler. Almost all the great mathematicians of the eighteenth 
century and the first half of the nineteenth century made some contribution to 
the development of the theory. Interest has recently returned afresh to continued 
fractions, owing to their great theoretical and practical value. In particular, con- 
tinued fractions are employed in various approximate computations. For instance, 
with their aid we can compute approximately the values of many functions, the 
power series expansion of which are slowly convergent or even divergent. 


§ 1. Continued fractions and their fundamental properties 


1. The evaluation of convergents. Convergents 


The terminating continued fraction 
ay ay an ea: P n 
oT B+ Be bs On 
ptont... +O, Qn 
is called the nth convergent of the continued fraction (5.1). We put 
here 


b 
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Basic recurrence relations: 
yap = bnPn—1 +AnPn—2) 
0, ca nQn-1 zn QnQn-2 


Equations (5.2) enable the convergents to be evaluated successively. 
It is useful here to employ the following scheme: 


Gi 1, 2, 3y°e<a). (5.2) 


Qa a a. 
b Bo, ee a : 
ae re ee ee 
Lbo PL Poo Pr 
0 ] 0; QO» 0, 


EXAMPLE 1. 


V2 = 14+(/2-1) = 1+ - 


qe 2. 1 1 
= 242+ 2+ 2 4+ 2+ 
1oLo 3 F Wo 4 99 
0 l 2 5 12 29 70 
1 1:5 1:4 1:417  1°4138 1:41429. 


The difference between neighbouring convergents is 


Pa Pana _ —_ 1\r+1 @1Q_..-Q, = 53 
On Qn-1 7?) On-10h (1 eas eer (5.3) 


The difference between convergents whose indices differ by 2 is: 


Pace. Prat Qa... Ayd 

efi ari = (- 1 rts eee tn = 1, 2, 3, ...). (5.4) 

ea Ga) Oso, 
Continued fractions whose partial quotients have positive terms. 

It follows from equations (5.4) that, if all the terms of the partial 

quotients are positive, the convergents of even order form a mono- 

tonically increasing sequence, bounded from above by the number 


by+a,/b,. Such a sequence has a limit. Consequently, lim P,,,/Q,, 
nN —> co 
exists in this case. Similarly, if all the terms of the partial quotients 


are positive, the convergents of odd order form a monotonically 
decreasing sequence, bounded from below by the number by. Such a 
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sequence also has a limit. Thus lim P,,,_,/Qpn,_, also exists. Thus 
Ti —> oo 


the value (if it exists) of a continued fraction, of which all the terms 
of the partial quotients are positive, is always greater than any con- 
vergent of even order and less than any convergent of odd order. 
The number lim P,/Q,, is taken to be the value of a continued frac- 


TN —> oo 
tion (5.1). 


2. Transformations of continued fractions 


The fundamental identity transformation is 


a a. a 
P14, =P Pe Pn—-1Pn4n (5.5) 


Pe on ae ee ae ee ee 


where p,, Po,... are any numbers, finite and non-zero. 
Ordinary continued fractions. By using transformation (5.5), we 
can always reduce a continued fraction (5.1) to the form 


I 1 I 


kEg9+—- — — 5 (5.6) 
ay + Xp» + eee t+ An + ooe 
where 
re _ 4244 --- Qo, —20on—1 _ 403... Qop—10or 
OS Oe RES ae aa to, = —___—_——_—. 
143. ee Ank~1 QQ, eee Qoh 


We call (5.6) an ordinary continued fraction, while the numbers «,, 
Q»,...are the partial denominators of the ordinary continued 
fraction. 

An ordinary continued fraction with positive integral partial 
denominators is said to be regular. Only regular continued fractions 
are usually considered in the theory of numbers. 

Continued fractions, of which all the partial denominators are equal 
to 1. Such fractions are obtained from the fraction (5.1) by a trans- 
formation (5.5) in which we put p, = 1/b,(n = 1, 2, ...). When 
by = 0, such a fraction has the form 


; (5.7) 
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where 
a a 
=i ay Set GS: 2°35 -22-2) 
The terms of the partial quotients of fractions (5.6) and (5.7) are 


connected by the relationships 


P l 
ay n—1% 


Daniel Bernouili’s continued fraction. The continued fraction, the 
convergents of which are equal to Ko, K;, K2,..., has the form 


Ki—Ky K,—K, (K,—Ko)(Ki— Ks) 


Ky + l + K,— Kg+ K, — Ky +... 
(Kn—2~ Kn—3) (Kn-1— Kn) 
So . 5.8 
e + Ky, — Ky~2 + eee ( ) 


EXAMPLE 2. The continued fraction for which K, = 1/(n+1)? 
(n = 0, 1,...), has the form 
3 15 3.7 5.9 (2n — 3) (2n+ 1) 
41~42-—~43-44~...—- 4n oe 
15 


3. Contraction and extension of continued fractions 


If we take as Ky, Ky, Ko,...Some subsequence of convergents of 
fraction (5.1), we say that the fraction (5.8) has been obtained by 
means of a contraction of fraction (5.1). Whereas, if we take as Ky, Kj, 
Ky, ... a sequence which includes in particular all the convergents 
of (5.1), we say that the fraction (5.8) has been obtained by means 
of an extension of fraction (5.1). 

After putting K, = P,,/Q.,, we have 


a, a An abe 
COE be tac die eee hb ee = 
AyD, Ayasb,b, 
— (baby + a3)b, + bya, — (b4b5 +.as)bg + b,a,—... 
on —24on—109n—4Dan (5.9) 


++ = (Oan-2den—1 + Gon— D0 on + Oon—24an — ++. 


246 MATHEMATICAL ANALYSIS 


EXAMPLE 3, 

1 2 1 ] l 
2=1+-— — = ee ae 
Se as ie es a ee 
1 7 41 239 
- 9 169 


On putting K, = Pon41/Qona1 We have 


b gal on On a bobs 4% 
ee eee ee ee a, Oe ee a — 
QQyb; a,0,b,b. 


- (6,5, t Qy)bz mi bia, = (6554 + a,)b; + bas ane gr ot 


Aon 149nDon—30on41 
a (ban—152n + Aza)ban41 + bon-142n41— irae 
Here, the sign = indicates that the convergent of zero order of 
the continued fraction on the right-hand side of the last equation is 
the fraction 1/0, and not 0/1, since this continued fraction has for 
its convergents the convergents of odd order only of continued frac- 


tion (5.1). 
EXAMPLE 4, 
l ] * § l ] l 
] 2 = — — = — —_— —_— : 
+2 SL ae Oe ec se 7 eae ee ee 
1 5 29 169 985 


0 2 12 70 408 
If we replace the sign = by the usual equality, we get the expan- 
sion 


5 . 5 I I l 
7W+D=F_F¢_E_G_.- 
0 5 30 175 1020 
I 2 I! 64 373 


The connection between ordinary and singular values of a continued 
fraction. If by = 0, the continued fraction (5.1) can be considered in 
two ways, depending on whether we take its zero order convergent 
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as equal to 0/1 or 1/0. In the first case the values of the continued 
fraction are described as ordinary, and in the second as singular. 
On writing K and K respectively for the ordinary and singular value 
of the same continued fraction, we have 


a, a ~ * a a 
Ke ek. 2s ; ack ; 
b, + bg +... rt+ogt+... 
0 a a,b, 1a a,b, + ae 
] b 1 b,b, + Qo, 0 b, bb, 


ba. 


1 
0 q a,b, + ay 
T Bh | Bb, 


It follows that the connection between K and K is given by 


K= en! ae 
b,K+ by, — a, 


4. The transformation of a continued fraction resulting from a 
theorem of Stolz 


The following is well known in mathematical analysis: 
STOLZ’S THEOREM. Let 
Lim P, = -, Lim Q, = @ Qyii > Qn 


t= oo Il—> co 


for all n. Then 


fin ee ti ee 


N—> co Q, N—> co On+1—Qn’ 
if the limit on the right-hand side of the last equation exists. 
By using this theorem and the basic recurrence relations (5.2), 
we can transform the fraction (5.1) into a continued fraction, whose 
nth order convergent is (P,—P,_,)/(Q,—Q,_,), where P, and 
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P,_, are respectively the numerators of the mth and (m—1)th order 
convergents of the continued fraction (5.1), while Q, and Q,_, are 
the denominators of these convergents. This continued fraction 
has the form 


a Ay, Qa; a,+b,—1 


bya te 2h peat ie i 
oe fc bey OC hee bed 
a,+b,—1 a,+6,—1 
a, +b,—1 iS ES CRT ag 
a,+b;—1 = An +by,— 1 
+ bs ue as +...¢+ 5, gee I oe 
EXAMPLE 5. 
Il 1 1 #1 
eee ele eee 
123 7 1 
1 1 3 4 #11 
~ 0O+14+14+3 41434... 
J 1! 3 4 24 
1 0 2 2 414 


A more general transformation of continued fraction following from 
Stolz’s theorem. We apply Stolz’s theorem to the sequence 


YnPn 
WO, 15 2, «.<4); 
ao ( ) 


where P,/Q,, (n = 0, 1, 2,...) are the convergents of (5.1), and 
Vi, Yoo+.- are any non-zero numbers. Now, if the inequality y,Q0, > 
Yn-1Qn- 18 Satisfied for all n, we have, by Stolz’s Theorem: 

n 


lim Pa lim YnPn—Yn—1Pn-1 
n=xco On n—>eo YnQn— Yn-1Q9n-1 


if the limit on the right-hand side exists. 
By using this equation and the basic recurrence relations (5.2), 
we can transform (5.1) into a continued fraction, whose mth order 
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convergent is (7,P,—Yn—yPn—p/nQn—-VYn—-12n—-p This continued 
fraction has the form 
ay ay 


K = 5,+—4 meld = 
BAe bees ED a ass 


1 
: — (VV 242 + YoVeb2 — YoYv) 
ye Y1% V1 
¥151—- Yo + 2 b,—1 + 
V1 
Y2V343 + V1¥303 — ~V172 
ViV2d_ + Yov22— 11 
¥303 — V2, Yo V2Vs43+¥17'303— Vive +--- 
Ve V2 ViV242 + Yov202— Yor 


Yn—1¥n9n + Yn—2¥nOn — Yn—2Yn=1 


+ 


RE” SE QAn-1 
Yn—2¥n-19n-1 + Yn—3Yn-19n-1 ~ Yn—~3Vn—-2 
4 Ynbn = Yn=1 42am Ya—1¥n8n + Yn—2YnOn — Yn—2Yn-1 
Yn=1 Yn—-1 Yn—-2Yn—19n—i + Yn—3?n—19n—1 — Yn—3n~2 
BE seed 
EXAMPLE 6. 
(Yn = n+l n= 0, I, 2, ) 
1 J] l 
2=1l4+—- = 
sa 2+2+ +2+ 
- 2 5 It 95 319 pete 
= Pog eo ahd 696 a4 es 2(n* — 3) Hee 
1 5 15 235 7535 


13 ll 165 5335 

This gives us an expansion of J/2 as a non-periodic continued 
fraction. In number theory there is a theorem which asserts that every 
irrational square root can be expanded as a periodic continued 
fraction and that, conversely, the value of every convergent periodic 
continued fraction is some irrational square root. But it is not always 
pointed out that an irrational square root can also be expanded asa 
non-periodic continued fraction, there being an infinity of such ex- 
pansions. The expansion. of ./ 2 obtained by us as a periodic con- 
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tinued fraction is more slowly convergent than the initial expansion 
of <f 2. ; 

Corollaries of Stolz’s theorem and transformations of continued 
fractions following from them. Let the sequence {P,/Q,,} satisfy the 
conditions of Stolz’s theorem. The sequence {P?/Q?} now also 
satisfies the conditions of the theorem. Therefore © 


a sa eee Pe 
lin. —— =: im: 2, 
jew Ox n—> oo On+Qn-1 


We can obtain, on the basis of this equation, the following trans- 
formation of a continued fraction: 


a Gn _ a 
a Se 
bs at] bya—an+1 
b,—a,+1 by—a,+1 7 ba1—@n—1 +1 °7 
— b,+1 + b,—a;+ 1 . bn— antl 
aa anes el ae en mares ae 
EXAMPLE 7 
1 1 1 =1 
ee. ees ere 
1 2 1 4 1 4 


ee ee es eee 
The following equation may also readily be obtained from Stolz’s 

theorem: 

Pr — lim YnPnt£Yn—pPn—h 

N—> co On N—> co YnQn + Yn-kQn—k 


where {y,} is a sequence, the terms of which are all non-zero. We 
can obtain on the basis of this equation as many different identity 
transformations of a continued fraction as desired. 
A further transformation of continued fractions. Let us consider the 
identity 
a & ite oe ea (5.10) 
bt+bo+... Ltd +@+... 
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Let us suppose that the convergents of even order of the fractions 
appearing in this identity are equal if their indices are the same. 
Now, on performing a contraction of the continued fractions and 
using the basic identity transformation to make corresponding terms 
of partial quotients of the contracted fractions equal, we obtain the 
following two systems of equations, connecting the terms of the 
partial quotients of the initial continued fractions: 


— bocyd, = abo, 


5.11 
CaCyd, = Ab, ( ) 


and Con—2Con—14an = Gen—24en~Wen—40on 2 = 2, 3, .... 
Cd, + dd, + Cy = bb. + ap, 


(don —2don—1 + Can—1)4an + Gony2Con = (5.12) 
= (bon—2ban—1 + Gon—1)0en + Oan-24an (m1 = 2, 3, ...). 


Systems (5.11) and (5.12), taken together, contain 2n equations 
with 4n unknowns c, and d, (m = 1, 2, ...). It is thus impossible, 
in the general case of equations (5.11) and (5.12), to express c, and 
d,(n = 1, 2, ...) im terms of a,, a,...,5,, bg,...0r, conversely, 
a,,5,(m = 1, 2,...) in terms of ¢,, cy,..., d,, d,.... But if by = 
1 Co SO Gyn = Day den = ADegy = ly 2ya2e 5 Ay Se 1); 
the identity (5.10) takes the form 


14H Se Oy 
by tbo t+... tOn t+... 
-1 ___ aby a aby 
1 ~ a,b, 3- byb, + 2a, — l — bybyb, + 2430, + 2a,b, = l we 
Qon—1Oon AanDon 2 
ee bon—20en-109n + 2A2n—15 2n + 2Aendon-2 = 1 oe Sire 
(5.13) 
EXAMPLE 8. 
1 1 1 2 1 #1 l 1 ] 
Ga ee ee Sees, fee te ee. ee 
Se aa an ae ee ee ee ee ee a 
O11 8 7 48 41 280 239 
11 6 5 34 29 198 169 
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If the equations 


_1 & & & Gon+1 Gan 
1] —'b, +b, + bg +... + bon +bongit... 


(5.15) 


5. The properties of regular continued fractions 


A continued fraction in which all the partial numerators are equal 
to unity, and all the partial denominators are positive integers, is 
described as regular, or arithmetical. It follows from equation (5.3) 
that all the convergents of a regular continued fraction are non- 
reducible. 

Euclid’s algorithm and the expansion of rational numbers as regular 
continued fractions. Let u and y be two given positive integers, where 
u > v. On dividing u by v, we have 


u = a uj 

y = 4 y ) 
where q, is the quotient and u, the remainder. On dividing v by uw, 
we have similarly 


Proceeding in this manner, we get 
a us 
= 4+ Wn 


and so on. This process of successive divisions is known as Euclid’s 
algorithm. Since u, u,, u,... iS a monotonically decreasing sequence 
of positive integers, the process is finite, i.e. there exists an index n 
such that u,_,/u, = g, (consequently, u, ~ 0, u,,, = 0). Hence 
u,, 1s the greatest common divisor of the numbers u and vy. It is often 
denoted by (u, v). 
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EXAMPLE 9. Find the greatest common divisor of the numbers 
816 and 323. 
The computation is usually set out thus: 


816 | 323 
“ee 
323 | 170 
“170 1 
170 | 153 
153|17 1 
0 9 


(816, 323) = 17. Thus the expansion of 816/323 as a regular continued 
fraction has the form 


eset 2 et 
23° eT aS 
Shee 
rT 2 9° 


Thus Euclid’s algorithm enables us not only to find the greatest com- 
mon divisor of two positive integers, but also to expand their ratio 
as a regular continued fraction. 

The solution in integers of an indeterminate equation of the first 
degree with the aid of Euclid’s algorithm. The equation ax+by = c, 
where a, b and c are known, while x and y are unknown, is known 
as an indeterminate equation of the first degree. Such an equation 
has an infinite set of solutions. But it is often required to find only 
the integers that satisfy the equation, ie. in conventional language, 
it is required to solve the equation in integers. We consider here only 
equations for which a, b, ¢ are integers. The equation ax+by = ¢ 
has an integral solution only in the case when ¢ is divisible by (a, 5). 
We can thus always assume that a and b are mutually prime. In this 
case the general solution in integers of the equation has the form 


x = (— 1)" *Qn_1+tQn, 
y = (—)"cPy-1— tPa, 


where ¢ is an arbitrary integer, P,_, and Q,_, are the numerator 
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and denominator of the penultimate convergent in the expansion 
of a/b = P,,/Q,, as a regular continued fraction. 
EXAMPLE 10. 43x+37y = 21. 


43 | 37 Lae ares nS 
37[6 1 37 6 + 6 
GI} 1 6 1 7 43 
0 6 1 6 37 


x = —21.64+37t = 37t— 126, 

y = 21.7-—43t = 147— 432, 
i.e. 

x = 37t—15, y= 18—43t, 


where again, ¢ is any integer. 

The convergents of a regular continued fraction as best approxima- 
tions. Suppose we have expanded any real number A as a regular 
continued fraction. Let us write P,/Q, for the mth order convergent 
of this continued fraction. The following inequality now holds: 


1 


Pr 
——— . 
OnQn41 


cero 


These convergents are best approximations to the number A in 
the sense that no rational fraction with denominator not exceeding 
Q,, can differ from A by less than the fraction P,/Q,. 

The expansion of an irrational number as a non-terminating regular 
continued fraction. Every real irrational number can be written uniquely 
as a non-terminating regular continued fraction. Conversely, every 
non-terminating regular continued fraction (such a fraction is necessar- 
ily convergent, by Seidel’s convergence test, see § 2, sec. 2) is the 
expansion of one and only one real irrational number. 

Periodic regular continued fractions. The regular continued fraction 

i 1 1 
Fo ai+t+Q.t... 
9., ... Of its partial denominators consists of a repetition, with 
the same period, of the m numbers gp, q3,---; Qn—1 

If the repetition starts with some q,(k = 1) instead of with qo, the 
regular continued fraction is described as mixed periodic. 


is said to be purely periodic if the sequence qo, 41, 
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Similar concepts of periodic continued fractions may also be intro- 
duced for continued fractions of a general type, although regular 
periodic continued fractions are primarily discussed in number 
theory. 

The expansion of irrational square roots as periodic continued 
fractions. Every periodic continued fraction (not necessarily regular) 
represents an irrational square root. An important role is played 
in number theory by a theorem of Lagrange, which states that 
every irrational square root can be expanded as a periodic regular 
continued fraction. 

For example, 


v5 +1 = es i i 
T+1]+1+... 
1 1 1 21 27 «1 ~=271 ~=1 «1 
Vier ere hod a eee ac 
Notice that the expansion of «/13 as a continued fraction of general 
type, 
s kt TIT 1 


4 
J13 = 3+ J/13-3 = 3 4+-—@——= = 34+—- — — — ; 
( 3+ ./13 34343434... 


is obtained more simply and is more rapidly convergent. Thus the 
expansion of irrational square roots as regular continued fractions 
is more of theoretical rather than practical interest. 


6. Equivalent and corresponding continued fractions 


When transforming the power series A )+A,x+A_x?+... 
into a continued fraction, two cases can be encountered: (1) the 
convergents of the continued fraction coincide with the partial sums 
of the initia] power series; (2) the convergents do not coincide with 
the partial sums of the initial power series. In the first case the con- 
tinued fraction is described as equivalent to the initial series, and in 
the second case as corresponding to the initial series. The expansion of 
the nth convergent of the corresponding continued fraction as a power 
series coincides with the initial power series up to and including the 
term in x”. It is clear that an equivalent continued fraction is only 
another form of writing a power series and does not yield new appro- 
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ximate expressions for its sum.-As regards convergence, a power or 
numerical series and the continued fraction corresponding to it can 
behave differently. They may be both convergent, or both divergent, 
or one be convergent and the other divergent. The domains of conver- 
gence of a power series and the continued fraction corresponding 
to it may thus be different. For instance, there are power series with 
radius of convergence equal to zero, which can be transformed into 
corresponding continued fractions that are convergent in a fairly 
wide domain. 

Equivalent continued fractions can sometimes be readily transform- 
ed into corresponding ones by means of the transformation (5.13). 
Since it is far easier to construct the equivalent rather than the 
corresponding fraction, the application of transforming equivalent 
fractions into corresponding ones is of practical interest. 

The construction of equivalent fractions. For this purpose it 1s 
easiest to employ Euler’s identity: 


y eg Ste Cx CoX C1CgX Cn—2CnX 
n=, Lo — Cyt CgX— Cot CgX— 2.6. — Cpiy tCnxX—... 
(5.16) 
This identity can also be given the form 
= Co C}XxX ColoX C1 CoX 
Y ¢.x*=—- —— ec en 
n= 0 1 — CoACUX— Cyt CoX— Cot Cgx— ... 
—navin® 5.1) 
° — Cpip $OnX mw eel 
EXAMPLE 11. 
x x 
arctan x = ae a ee : 
ee 9x? (2n — 1)*x? : 
~ 1 43—x? + 5—3x2 4+ 26. 4$2n4+1—(2n—1)x? +... 


In particular, when x = 1 we have, 


r 12? # S FP (2n— 1)? 
agian re ey oa ee on ae ee” a 
o1 2 13 76 789 

11 3 15 105 985 
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The last expansion was first obtained by Brouncker (1620-1684), 
This relationship is regarded as historically the first expansion of 
a transcendental number as a continued fraction. 

On applying transformation (5.13) to the expansion of arc tan x 
aS an equivalent continued fraction, we get the continued fraction 


arc tanx = x-—- chad ni ax 
-_ 15 +9x? — ] eens 
x 15x +4x243x5 15x—5x3 +3x5 
l 15 +9x? 15 


which is no longer equivalent. In particular, when x = 1 we have 


2 9 2 4 81 @n— 0 
24-1-—152- 1 —408-...- } —_ 


1 22 13 1426 789 
1 24 15 1680 945 


ws A 
Goe= 


(4n +1)? 
— 8(8n?+8n+3) —... 


7. The formation of corresponding fractions. Viskovatoy’s method 


The terms of the partial quotients of the corresponding continued 
fraction can be expressed in terms of the coefficients of the terms of 
the initial power series, although high order determinations appear in 
the relationships thus obtained. This makes such relationships of 
little practical use in the majority of cases. It is therefore better in 
practice to use a method of successively obtaining the terms of the 
partial quotients of the corresponding continued fraction from the 
terms of the power series. Such a method was proposed in principle 
at the beginning of the nineteenth century by the Russian scholar 
V. Viskovatov. Viskovatov’s method amounts to the identity, 


{(@) = Hq +%yyX +X QX* +Ayyxrt ... _ “10 20% %3o% 
Log HK opX He perx* +a ygxP+ ... Ayg+ Big + Mag +... 
where 


Lmn = %m~1, o%m—2, n+1 — m—2, 0%m—-1, n+1° 
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Computation of the coefficients «,,, may be conveniently set out 
in accordance with the scheme: 


ee e@ @ @ 8® ® 8 @® @ 


EXAMPLE 12. Let us expand the expression (1—x)/(1—5x+6x?) 
(x < 1/3) as a continued fraction. We have 


1 -5 6 
1 —-1 
—-4 6 
—2 
— 12. 
Consequently, 
l-x _i 4x 2x 12x 
1—S5x+6x?° 1—- 1 -— -4- —2- 
os ee, 2 
l1—- 1 + 2 - ] 
Eg l 2+x 2—2x 
] 


l1—4x 2-—7x 2-—10x+ 12x? 


If, when computing the coefficients <,,.,, it turns out that a,, = 0, 
then the (k+2)th row of the scheme is obtained by means of a shift 
of the (k+ 1)th row one place to the left; the (k+3)th row is obtained 
by combining the (k+2)th and the kth rows in accordance with 
the general rule, the (k+4)th row by combining the (k+3)th and 
(k+2)th, and so on. The expansion in this case has the form 


f(x) _ A109 AgoX AgqX 
2 ra rd 
Sr—1,0% %h,iX %h4i,1% A%h+2,1% 
ees + &p_o +1 ot Xr + Ch+i,1 + ose 
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EXAMPLE 13. Let us expand the expression (1—3x°)/(1—x?— 4x‘) 
(x? < (/17—1)/8) as a continued fraction, we have 


[-3x?_ 1 xt 3x Sx 25x 300x 15x _ 
ee oe ee en ee eee ee) 
_i # 3x ox 
“Ts FF. ae l — 3 + 
01 I 1+3x 3+-34x 
11 t—x® 143x—x® 34-4x-—3x? +538 
Sx 12x 3x 
+ “i, — S — 1 
349x + 15x? 15+9x+27x2 15—45x3 


34+9x+12x% 15+9x+12x? +36x9-—60x4 = 15—15x?—60x* | 


I 0 —-l 0 -—4 
] 0 0 —3 
0 —Ii 3 —4 

—| 3 -—4 

—3 4 3 

—5 15 

25 —15 

300 

— 300.15. 


8. Appell’s method 


In 1913 Appell proposed the following method enabling any 
positive number to be expanded as a continued fraction. 

Let N be any positive number. Let a be the square root of N, comput- 
ed with a deficiency of not more than 1. Thus N = a?+R, where 
0< R < 2a+1. Weshall assume a = 0if N< 1. We put R = (24+ 1)/N,, 
where N,>1. Let a, be the square root of N,, computed with 
deficiency of not more than 1. Then N, = a?+ R,, where 0< R,< 
<2a,+1. We put R, = (2a,+1)/N2 and continued this process inde- 
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finitely. Generally speaking, N is now expanded as a non-termin- 
ating continued fraction. 

If N, = N, Nis expanded a pure periodic continued fraction. If 
N, =N,,(1 =m <p), Nis expanded as a mixed periodic continued 


fraction. 
EXAMPLE 14, 
6 s > 
ee = =, ee one 
S=Pil=P+>, M=N, 5 oa) re) eae 
EXAMPLE 15 
3 = 3 3 
ees, Nigh hd: = ]?4-_— —= ]?+— 
2 
s 5 3 
ng |) an eee — = |? — 5 = 
2 
3 3 3 #§ 3-3 
‘ 2 2 2? a fee 
21 14 fia 24724 /f24 feu... 
second period 
EXAMPLE 16. 


Appell also pointed out the more general relationship 


= gn Gt Di—a? (a, +1)"-—a% 


N i 
a? + ay oh sts 


Here a,, a,,... are positive integers, while a may also be equal to 
zero. Here we can take the mth root of the number with a deficiency 
or with an excess of not more than 1, or we can even alternate in 
various ways the approximation of the root with a deficiency and 
an excess In the expansion obtained. 
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§ 2. Fundamental tests for the convergence of continued 
fractions 


1. The convergence of continued fractions 


It was mentioned above that a continued fraction for which lim 
l-—> co 


P/Q, exists and is finite is described as convergent. The value of the 
continued fraction is in this case taken equal to this limit. But it does 
not follow from the convergence of a continued fraction that lim 


Nt > oo 


P,/Q, 18 equal to the magnitude which has been expanded as the 
continued fraction. 
Essentially and non-essentially divergent continued fractions. If 


lim P,/Q, = + © or lim P,/Q, = — ©, the continued fraction is 

n—> co n—> oo 

said to be non-essentially divergent, whereas if lim P,/Q, does not 
N—> ca 


exist, the continued fraction is said to be essentially divergent. The 
concepts of essential and non-essential divergence were introduced 
by Perron. 
Unconditionally and conditionally convergent continued fractions. 
Unconditionally and conditionally convergent continued fractions. 
It is well known that the convergence of a series or infinite product 
is not affected by the removal of a finite set of terms. In continued 
fractions, however, the removal of a finite set of partial quotients 
(excluding the zero partial quotient) can turn a convergent fraction 
into a non-essentially divergent fraction. Pringsheim therefore intro- 
duced the following concepts: a continued fraction [a,/b, J] is 
said to be unconditionally convergent if, for all m = 1, the fraction 
{a,/b,]", is convergent. Whereas if the latter fraction is divergent 
for at least one value of m, the fraction [a,/b,]> is said to be 
conditionally convergent. It follows from this that it is not in general 
possible to quote convergence tests for continued fractions in the 
limiting form as used for series. The convergence conditions, connect- 
ing, say a, and b,, must be satisfied for all positive integral n. It 
‘must be emphasized that the removal ofa finite set of partial quotients 
can turn a convergent continued fraction only into a convergent or 
a non-essentially divergent fraction. 
A necessary test for the convergence of a continued fraction [1/a,]>. 
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Kocu’s THEOREM. The convergence of the series } |a,,| 
naj 
sufficient for the limits lim P,, = P, om | Pen 41 =P, lim Q,, = Q, 


TN —> co Ni -—> oo 
lim Q.,41 = Q' to be finite, and the relationship Pt Q—PQ' = 1 to be 
N—> co 
satisfied. It follows from this that the divergence of the series y |«,,| 
n=l 
is necessary for the convergence of the fraction [l/a,]}°. 

Uniform convergence of a continued fraction. If the terms of the 
partial quotients of a continued fraction are functions of a finite 
or infinite set of variables, the continued fraction is said to be uni- 
formly convergent on the set E of variation of these variables when 
its convergents P,/Q,, tend uniformly to a limit in £, i.e. when, given 
any e > 0, we can find a number N such that, for n = N, Q, is non-zero 
on the whole set E and the following inequality holds: 

Pp, P. 
~— lim — 


On A—> co Q), 
It follows from this definition that the series (see [3]): 


la — [Px Pai Py yan 4192 + = 9 
2 (Z a2 )= Ona a - Ons “On10, 


(5.19) 


< €, (5.18) 


is now uniformly convergent in E to lim P,/Q,, since P,/Q,, is its 
N —> oo 
partial sum, while lim P,,/Q,, is its sum. Conversely, condition (5.18) 
h—> oo 
follows from the uniform convergence of this series, i.e. the uniform 


convergence of the continued fraction. It also follows from this 
definition that the values of the continued fraction and of the series 
(5.19) coincide for any x € £, 1.e. that the continued fraction and the 
series (5.19) are identically equal on the set E. 

A condition for the convergence of a continued fraction to the function 
which can be expanded as this continued fraction. The uniform converg- 
ence of the continued fraction 


oy ee ei (cp #0; n=1,2,...) (5.20) 
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on the set E is a sufficient condition for this fraction to be convergent 
on the set £ to the function K(x), which can be expanded as the con- 
tinued fraction. 

It follows from this theorem that, if the fraction (5.20) is uniformly 
convergent for | x| <9, itis convergent for |x| <o to a regular single- 
valued analytic function, which can be expanded as the fraction 
and which can be expanded as the power series corresponding to the 
fraction (5.20), this series being convergent to the same function 
for |x|<o. The condition is therefore obtained in order that the 
continued fraction and the power series which correspond to each 
other are convergent to the same function. Notice that the domain 
|x |< can be replaced by any domain 7 containing zero as an interior 
point. 

If zero is a boundary point of the set Z, then o = 0, i.e. the power 
series corresponding to the fraction (5.20) 1s divergent everywhere 
except at zero. But the fraction (5.20), uniformly convergent on the set 
E,is nevertheless convergent on this set to the function that we have 
expanded as this continued fraction. This function can be expanded 
in the present case in a neighbourhood of zero as a divergent power 
series, i.e. it is not analytic. The convergents of the fraction (5.20) 
are thus approximate expressions for a non-analytic function, 1.e. 
we have to some degree solved the problem of the approximate 
evaluation of non-analytic functions. 

The condition for identical equality of two uniformly convergent 
continued fractions. If the values of two continued fractions, uniformly 
convergent inside a domain JT containing zero as an interior point, 
are coincident in a domain S which is contained wholly in 7, then 
these fractions are identically equal inside the domain 7. 

Uniform convergence of the fraction [c,x/\}",,- The uniform 
convergence of the fraction [c,x/l]>,, inside a domain T con- 
taining zero is sufficient for the uniform convergence inside T of the 
fraction K(x) = [c,/1; ¢c,x/1]3°, after the possible exclusion of a 
finite number of points x’ of non-essential divergence. The fraction 
[c,/1; c,x/1]" is convergent here inside T to a single-valued 
analytic function K(x), regular inside 7, except at points x’, which are 
the poles of this function. 
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2. A necessary and sufficient test for the convergence of a 
continued fraction in which the partial quotients have 
positive terms (Seidel’s test) 


As has been shown, the divergence ofthe series )' |a,,| is necessary 


n=l 
for the convergence of the fraction [l/a,]>. Seidel, and independ- 
ently Stern, showed that if all the terms of the partial quotients of 
the fraction are positive, the divergence of the series is necessary and 
sufficient for convergence. 
EXAMPLE 17. The continued fraction 


I 1 1 


M45 7404 ate 


is convergent by virtue of Siedel’s test, since the series 2+2+... 
is divergent. 

Notice that the convergence of a continued fraction in which the 
partial quotients have positive terms depends on the divergence of 
a certain series, i.e. the behaviour of the entire set of terms of the 
partial quotients, not on the behaviour of each of them. A convergent 
continued fraction in which the partial quotients have positive terms 
is therefore unconditionally convergent. 

On passing from a continued fraction of the form (5.6) to a con- 
tinued fraction of the general form (5.1), the following statement of 
Seidel’s test is obtained; this statement was proposed by Stern. 

The divergence of at least one of the series 


— 444, ..+ Agony — 4)04...Q 

en, eg (5.21) 
nel 4204..- on nel 4343 + - Gens 

is necessary and sufficient for the convergence of the continued fraction 

(5.1), of which all the terms of the partial quotients are positive. 


3. Tests sufficent for the convergence of continued fractions 
in which the partial quotients have positive terms 


Establishing the divergence of one of the series (5.21) ts usually 
fairly difficult in practice. Thus it is often more convenient to make 
use of various tests which are sufficient for the convergence of conti- 
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nued fractions with partial quotients having exclusively positive terms. 
Some of these tests are given below. 
1°. Divergence of the series ) (b,_,5,)/a, is sufficient for the 
. n= 
convergence of the fraction (5.1) when the partial quotients have positive 
terms (Stolz). 
2°. Divergence of the series > PY (5,,-15,)/@, is sufficient for 
n=2 


the convergence of the fraction (5.1) when the partial quotients have 
positive terms (Saalschiitz and Pringsheim). 
3°. Divergence of the series 


= 1 


nm3 Dy, 
T+ 
bn) 


is sufficient for the convergence of the fraction (5.1) when the partial 
quotients have positive terms (Arndt). 
Notice that, if 


Qa a a. 
K=65b + ani} —_ ; 
: b, + be + oee +b, 5 a ° 
then 
ay Qa, an 


eS Spee fis 
ot —by+—bot... +—-Ogt... 


Hence all the tests for convergence of continued fractions in which 
the partial quotients have exclusively positive terms may readily 
be extended to continued fractions in which all the partial numerators 
are positive and all the partial denominators negative. 


4. First set of tests sufficient for convergence 


Let the numbers r,, 7.,... satisfy the following conditions (Scott 
and Wall), 


1) ry |[1+cq| = [ce], 

2) re |1+cg+c3] = |c3], 

3) Pal l+en tena. | = Taln—2lenl +1 ¢n42! (n = 3), 
4) r, 20 (n = 3), 


(5.22) 
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where Co, C3,... are the partial numerators of the fraction 


ae as : (5.23) 


If the series )\ ryrg...1, is convergent, then the fraction (5.23) 
n=l 
is convergent, while 


IK] 14 Vo rrp... tp (5.24) 
n=] 


If the numbers 7,, r.,... satisfy conditions (5.22) and at least one 
of the c, is zero, the fraction (5.23) is convergent. 

If c,, Cg,... are functions of several variables, the above converg- 
ence test takes the following form. Jf the numbers r,, ro,... satisfy 


conditions (5.22), and the series }\ ryr,...1, is convergent on a set E, 


n=l] 
the fraction (5.23) is uniformly convergent on E, inequality (5.24) 
being satisfied. 
In particular, the set E can be chosen on the basis of the following 
theorem due to Scott and Wall: 


The set of conditions 


Pr-l 


>1, |c,|s 
i n Pn-1iPn 


(n = 2, 3, ...) (5.25) 


where P,, P2 are the terms of some numerical sequence, is sufficient 
for uniform convergence of the fraction (5.23) and for the following 
inequality to be satisfied: 


ca ee es! 596) 
AW! rae 
: L+ 2 @-Dim—D---@a-D 


Inequality (5.26) becomes equality if c, = (l—p,)/p,_ Pp, ( = 2, 
Sita) 
If p, = 1, Scott and Wall’s theorem takes the following form. 
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The following conditions: 
(1) py = 1; 


Pa—! ‘ 
2 lc,|s S28 eh 
2) n| Pn—-1Pn ( ) 


(3) the series ) (pg—1)(p3—1)..- (Pa4;—1) is convergent; 
r= 


1 
are sufficient for the uniform convergence of the fraction (5.23) and 
for fulfillment of the inequality 


[KI = 1+ 5 (a D(P-1).--Pnt1—D. 


This becomes equality if c, = (1—p,)/P,_,P, (2 = 2, 3, ...). 
In particular, of p, = (2n+1)/(n+k), the following theorem is 
obtained, by virtue of (5.25) and (5.26). 
The condition 
n* — (k — 1)? 
4n? — 1} 


is sufficient for the uniform convergence of the fraction (5.20), while 
we have : when k x 2, 
3 


l 
2-—k = 2—-k 3-—k n+1—k 
1 
| + 2 


(n = 2, 3,...) (5.27) 


Icnl Ss 


l=k 24k "°° +k 


An investigation of the series in the denominator on the right-hand 
side of the last inequality shows that the series is convergentfor k > 1 
and divergent for k = 1. In addition, it follows from inequality (5.27) 
that ~1< k < 3. Hence, when —1 < ks | (5.28) takes the form 


a (5.29) 


and only retains the form (5.28) for 1 < k <3. 
Vorpitskii’s test. When k=1/2, we have p,=2. In this case 
(5.27) takes the form 


I 


4 (n = 2, 3, sae )s (5.30) 


lc,| Ss 
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while | K| = 2 in accordance with (5.29). But we can replace (5.29) 
by the stricter inequality: 


2 
= a (5.31) 


4 
oe 


VAN VLECK’S THEOREM. The condition 
0O=¢, 22 (n = 2, 3, ...) (5.32) 


is sufficient for the fraction K = [1/l, c,z/1]f to be convergent in 
the circle |z| < 1/4g to a regular analytic non-rational function, which is 
also equal to the series corresponding to this fraction, while | K— 
— 4/3] s 2/3. 

The proof of this theorem follows from Vorpitskii’s test. 


5. Tests for the convergence of continued fractions periodic 
in the limit 
The fraction {a,/b,)°, for which a, # 0, lima, = a, lim b, = 5, 


v—> oo v —> oo 


is described as periodic in the limit. Such fractions are of great practical 
importance, since they are connected with the expansions as continued 
fractions of a large number of commonly encountered functions. 
The convergence tests for continued fractions periodic in the limit 
follow from the theorem: 
The condition lim sup {|c,|} Sg is sufficient for the fraction 


v <> co 
Ci ; Cyz aa 
it : + | (5.33) 


2 


to be convergent in the circle |z|< 1/4g (excluding possible poles) to a 
regular analytic non-rational function, the poles of the latter being 
the points of non-essential divergence of the fraction. In a neighbourhood 
of zero this function is equal to the series corresponding to the continued 
fraction (5.33). 

Having chosen as the g in this theorem any positive number, as 
small as desired, we pass to the following theorem. 

The condition lim c = 0 is sufficient for the fraction (5.33) to be 


P —> co 
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uniformly convergent in any finite domain of the complex plane, excluding 
a finite set of points of non-essential divergence, to an analytic function, 
which is regular in a neighbourhood of zero, and is regular in the re- 
mainder of the domain except for the above-mentoined points of non- 
essential divergence of the fraction, these being the poles of the func- 
tion. The point z = ~ is essentially a singular point of the function. 


To generalize this theorem, we assume that lim c, = c ~ 0. We 
v —> oo 
thus arrive at the following theorem. 


The condition lim c, = c # Ois sufficient for the uniform converg- 


vy => oo 
ence of the fraction (5.33), excluding a finite set of points of non- 
essential divergence in any domain T < T, where T is the complex 
plane with a cut along the real axis from the point (—1/4c, 0) to an 
infinitely remote point, such that the cut does not pass through zero. 
If the cut starts from zero, the following Stieltjes test holds. 
Suppose the following conditions are satisfied: 


(1) &, &,... are real and non-negative; 
(2) a, &,...5%on43,--- are not all zero; 
(3) the series )° a, is divergent. 


k= 
Then the fraction [z/«,]?° is uniformly convergent in any finite 


domain lying inside the complex plane, cut along the negative part of 
the real axis. 


§ 3. The expansion of certain functions as continued 
fractions 


1. Lagrange’s method 


Lagrange proposed the following method of solving differential 
equations with the aid of continued fractions. Suppose we have a 
differential equation in y and x, and assume that y ~ &, when |x| ~ 0. 
We now puty = &,/(1+,y,) and substitute this relationship into the 
original equation. We obtain a differential equation in y, and x. 
Suppose y, ~ &, when |x| ~ 0. We put y, = §,/(1+y,.) and repeat 
the process. All in all, we arrive at the solution of the original 
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equation in the form of the continued fraction [€,,/1];°; &, is more 
conveniently sought in the form a,x"*, where », = 0. 

Many differential equations can be solved by this means, but it 
generally proves difficult to find the dependence of €, on the index 
n, 1.e. to find the general partial quotient of the continued fraction. 


Z. Fundamental differential equation 


Let us apply Lagrange’s method to the equation 
(a+a'x)xy’ +(B+B'x)y + yy = ox, 0) = 0. (5.34) 


Having put y = dx/(«+8+y,), the equation is reduced to the 
form ° 


(% +a’x)xy' +[a+B-(@’+P)x]y, +9? = (+B) (@' +8) +76)x. 
On repeating this process, we get the continued fraction 


_ Ox  [(@+B)@' +B) +yd]x (aa’- af’ +a'B+0)x 


~ &+Bh4 2a +B + 3a +8 Beds 
[(nx +B)(na' + B’)+yd)|x (Wao — naB’ + na'B + yod)x 
+ 2nx +B + (2n+1)2+8 eee dit 


It is readily seen from this that the differential equation 
(x +a’x*)xy'+(B+B'x*)y+yy = dxk, = 0) = 0 (5.35) 
has the solution 
ya Oe Wee +B) ho + B+ vd 
ka+B+ 2ka+Bo2S™C~SE 
(kPocx' — kB’ + ka’B --yd)x* 
+ 3ka + B ee 
[Waka +B) (nkx’ + B’) + yd)x* 
wee t+ 2nka + B + 
(n®k* xa’ — nkaB’ +- nko’ B + yd)x* 


+ (2n + 1)ka +B aE ae ee) 


Almost all the differential equations, the solutions of which were 
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expanded as continued fractions by Lagrange, Euler and others, are 
particular cases of equation (5.35). It is therefore natural to refer to 
(5.35) as the fundamental differential equation. 


3. The expansion of a power function as a continued fraction 


Let us put y = (1+x)’, where v is any real number. Then (1+ x)y’ = 
=vy = vy, y(0) = 1. On putting y = 1+»x/(1+z), we reduce the 
differential equation to the form 


(1+ x)xz’+[1—(1— »)x]z +2? = (1—7)x, z(0) = 0. 
This is a particular case of equation (5.35), in which 

kKzezaze@’=f=ay=1, P= -(l-»r, d=1-». 
We thus have, from expansion (5.36): 


ym (1l—-v)x (1+ 7)x 

l+ 2 + 3 + 
(2—v)x (n—v)x (n+yv)x 
D2 a ee De Dae Se 


(i+x)? =1+ 


(5.37) 


This expansion was obtained by Lagrange. In view of the above- 
mentioned convergence tests, it is convergent on the complex plane 
cut along the real axis from x = —wotox= —l. 

The power series into which the function y = (1+x)” can be 
expanded is convergent in an open circle of radius 1 with centre at 
the origin. The expansion of the function y = (1+.x)” as a continued 
fraction is therefore convergent in a much wider domain than the 
expansion of the same function as a power series. 

EXAMPLE 18. On putting x = 1, » = 1/3, we have 


2 4 3 3n— 1 3n+1 
t+2+9424...+ 2 +3(2n+I1)4+... 
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On contracting the expansion (5.37) in accordance with formula 
(5.9), we get 


ss 2x (1 — 2?)x? 
Gaal = 2) oa ae 4 304 x 
(4— »?)x? (n? — v°)x? 
— 5(2+x) —...-—(Qn¢DQ4xn-...” 


This expansion is convergent in the same domain as the expansion 
(5.37). 

Irrational square roots may be expanded as continued fractions 
by means of the following elementary method. 


Let J/x =a. Then Vx = a+(./x—a) = a+(x~—a?)/(a+4/x). 
Consequently, 


De reas x-—a? 
7 2a te DG Se ee 


This expansion is convergent on the complex plane, except the nega- 
tive part of the real axis. 
4, The expansion of a logarithmic function as a continued fraction 


Expansion (5.37) can be put in the form 


(—v)x (l+7)x (2-—»)x 
+ 2 4+ 3 + 2 
(2+ )x (n—v)x (n+v)x 
+ § +...% 2 + 2n4+1 4... 


(+xy-1 


y 


x 
] 


On setting » = 0, we obtain, since lim [(1+ x)’—1]/» = In(1+x): 
Vv —> + oo 
x -: a (2X 2xX nx nx 


DO ee ese TS Pua 4 nian G38) 


This expansion and the method of obtaining it from expansion (5.37) 
were found by Lagrange. Expansion (5.38) is convergent on the 
complex plane cut along the real axis from x = —» to x= —1l. 
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EXAMPLE 19, On putting x = 1, we have: 


1 


In2 = fee 


Te OS hy Ser) ae 
ol 
1 1 


5. The expansion of an exponential function as a continued fraction 


On replacing x by x/», expansion (5.37) takes the form 


ta. l+? . ia 
eed Soj.an v y 
v 1+ 2 + 3 + 2 4+ 
2+ n—v n+ 
y y y 


- & Ati 20 ids ed. Be 
On letting » tend to , we obtain in the limit: 


Poe ta x x x x x x 


2 eo Ss ice P= (5.39) 


This expansion is convergent on the entire complex plane. The expan- 
sion and the method of obtaining it from expansion (5.37) were 
discovered by Lagrange. On contracting the continued fraction 
(5.39) in accordance with formula (5.9), we arrive at the expansion 
obtained by Euler: 


2x x* = x? x? 


er Pe 6 10 oe eee ab ee 


This expansion is also convergent on the entire complex plane. 


6. Expansion of the function y=arc tan x as a continued fraction 
The differential equation for this function has the form 


, l 


y= Tox2” y(0) = 0. 
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On setting y = x/(1+z), this equation reduces to the form 
(1 + x*)xz’ + (1 — x*)z+27 = x’, 
This 1s a particular case of equation (5.35), in which 
a=’ =P=yordb=1l f= -1, k=2. 
We therefore have, from expansion (5-36): 


2 4x2 9x? n*x? 


XxX 
Bt Be] a OH (3.40) 


x 
arc tan xX = i = 


x 
+2Z j 


of 


This expansion was discovered by Lambert (1728-1777). It is conver- 
gent on the whole complex plane except for two cuts along the imag- 
inary axis from —oo ij to —1, and from ito +i. This expansion 
is thus convergent in a far wider domain than the power series into 
which the function y = arc tan x may be expanded (this latter series 
is convergent inside the unit circle with centre at the origin). 

The terms of the partial quotients of fraction (5.40) satisfy condi- 
tions (5.14). We can thus obtain a further expansion of arctan x 
on the basis of equation (5.15): 

x3 9x? 4x? (2n+1)2x? (2n)*x? 


HCN ae aes ee yy ae ET Ae Ap ee wee 


x 
7. Expansion of the function y -| at/(1+t") as a 
continued fraction ’ 


The differential equation for this function has the form 


; ] 


y ~ T4xk? y(0) = 0. 


On putting 


the equation reduces to the form 


(1+ x*)xz'+(1—x"*)z42? = xh. 
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This is the particular case of equation (5.35) whenz =a’ =fB=y= 
=6= 1, Bf’ = ~—1, k is any number. We therefore obtain, from 
expansion (5.36): 


+kK+142kK+1+ 3k4+1 +... 


Wk2xk = (nk +1)®x* 
wee f Qnk+14 2n4+DkK4+1 ¢...0 


{. dt x xe  kexk (k4+1)%x* 
oe i 
(5.41) 


This expansion was obtained by Lagrange. It is convergent on the 
plane of the complex variable x*, cut along the real axis from — 
to —1. When k = 1, expansion (5.41) becomes the expansion for 
In(1 +x); when k = 2, it becomes the expansion for arc tan x. 


x 
On substituting xt! for x in the integral | dt/(1+t*) and setting 
0 
k(p+ 1) = gq, we obtain from (5.41) the expansion 
= ¢Pdt = xPtl = (p+1)*x! g*x4 
pitt p+el+qtl+pt 2q+lip+... 


n*q?x4 (ng + 1+ p)*x? 


—_ ‘ 5.42 
0. $2ng+1+p+ (Qn4+)q+l+pt+... ee) 


For example, 


= 7? dt ik: Zz 16 49 167° (4n + 3)? 
pitt) 3 +7 +11 +15 +...+ 8743 + 8747 +...° 
O1 7 93 1738 
13 30 378 71 


On using conditions (5.14) and equation (5.15), we can write (5.24) 
in the form 


x ¢P dt _ xPtt xP+1+¢ (q+1+p)*x? 
) 140 pti q+l+p+ 2g+1+p 
q°xt (ng +1 +p)*x? n®q?xt 
+ 3g+lt+p+...+ 2nqt+l+p +(2n+)qt¢i+pt+... 
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For example 


1 Pd 1 ol 49 16 (4n+3)% 16n? 

> ittt 3 a ee os ee ee ee ye), ae 
1 4 93 1459 
3 21 378 6006 


8. Expansion of tan x and tanh x as continued fractions 


The differential equation for y = tan x is of the form 


y=1+y, y0)=0. 
On putting »y = x/(1+2), this equation reduces to 
x2’4+72+22? = —x?. 
This is the particular case of (5.35) whena’ = f’ = 0,2 = B=y = 1, 
6 = —l1, k =2. We thus obtain from expansion (5.36): 
x x x? 
ee eee ate One ee, 


This expansion was discovered by Lambert. It is convergent on the 
whole plane of the complex variable x, except for the points at which 
tan x becomes infinite. 

On replacing x by x/i in expansion (5.43) and multiplying the 
resulting equation by i, we obtain 
x? x? 
TS iuaweoetien 8 


9, Expansion of Prima’s function as a continued fraction 
The integral 
[- 12-1 e-t dt (a> 0, x > 0) 


x 
is known as Prima’s function. Let us introduce the function 


PS xe | t2-le-t dt, 


so 
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which satisfies the differential equation 
xy’—-(l-—a+x)y = —x. 
On putting x = 1/t, y = 1/(1+n), this equation takes the form 
tu’ +[1—(1—a)t]u = (l—a)t, u(0) = 0. 
This is the particular case of equation (5.35) whena =0,k =a’ = 


=B=y=1, BP = —(l—a), 6=1-—a. We thus obtain from 
expansion (5.36): 
(l—ajt ¢t (2—-a)t nt (a+1—a)t 

1 +1+ 1 +...4 14 l +... 
On returning to the original notation, we get 


* esti eo l-—a a 2—a 
7 a ee ee ee es ee ee 


um 


n n+il—a 
txt 1 Bo gece. 


On contracting this expansion on the basis of formula (5.9), we get 


" e-ip-tg 2 Ce 2a) 
‘ x¥+1l—-a-—-x+3-a-—-x+5-a-... 


(5.45) 


n(n — a) 


2. —- X+2n+1-—a—... 89) 


x 
We call | (e'/t) dt the integral exponential function and denote it 


by Ei(x) (see (6.393)). We obtain from expansion (5.45) with a = 0 
and x <0: 


: 1 l l non 
Sipe bes ce ee oes, po 
se ad ae 2 an O27) 
The function 
Ein) = ["E 
> int 


is called the integral logarithm and is denoted by li(x) (see (6.394)). 
We obtain from expansion (5.47): 


x 1 l n n 


2 a ea ae es ee 
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10. Expansion of the incomplete gamma function as a 
continued fraction 


To obtain an expansion of the incomplete gamma function, i.e. 
of the integral 


| " 8-le-t dt (a >), 


0 


we introduce the function 


=x 
y= ve | t2-le—t dy (x > 0), 


0 
which satisfies the differential equation 
xy'+(a—xy-1 = 0, WO) ==. 
On putting y = 1/(a+y,) in this equation, we get 
XV, +(4+x)yi+i = —ax. 


This is the particular case of equation (5.35) whenk = a = f’ = y=1, 
a’ = 0, B =a, 6 = —a. We thus have from expansion (5.36) 


eee ee x%e-* ax x  (1+a)x 
; a —l+a+2+a-— 3+a 
2x nx (a+n)x 
+4+a—...+2nta—2n+lia+... 


11. Thiele’s formula 
The Taylor series 
h , h ” h" (n) 
f(x +h) =fO)+7f +s (x) +... top fx)... 


corresponds in the theory of continued fractions to Thiele’s formula 


h h h 
Jet IC)+ 5 4 Ir, K(x) + 3rref(x) +... 
h 
wee bry f(x) + oe 
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Here r,, f(x) is called the inverse derivative of the n-th order of the func- 
tion f(x). The inverse derivatives are defined by the relationships 


f(x) = = 5 )? ro f(x) ore F(x) + 2rr, f(x), 


and in general, for n = 2, 

Paf(X) = lao (x) +0rra_sS). 
For example, 

re = e-*, roe* = —e*, 0.45 lone = (— 1)"N", 
Tontie’ = (— 1D" (n+ De®. 
Hence 
(22+ 1)rrene* = (— 1)" (Qn + 1)e~*, 

(2n + 2)rron4 ie" = 2(—1)**1e*. 
If we use these relationships and replace x by 0 and / by xin 
Thiele’s formula, we again arrive at expansion (5.39). 


Thus Thiele’s formula is another source of obtaining the expansions 
of various functions as corresponding continued fractions. 


12. Fractional approximations for sin x and sinh x 


The general form of the expansion as a continued fraction of sin x 
is not known. Only a finite set of partial quotients of the expansion 
can be found by Viskovatov’s method. For example, 


sin xX = &. x 1 lL? 551x? : 
lI+ 6 — 10 + 98 — 198 +... 
x 6x 60x — 7x3 5880x — 620x3 
1 64+x2 6043x2 5880 + 360x? + lixt 
and 
snx =x —- > = Lt 25x" ; 
6 + 10 - 42 + 66 —... 


x 6x—x? 60x—7x* 2520x— 360x? + 11x5 
1 6 60 + 3x? 2520 + 60x? 
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It follows from the approximation 
sin x ~ ———__ (5.48) 


that sinz/4 ~ 0-7071, if we put 2/4 = 0-7854. Hence, in view of 
the periodicity of the function y = sinx and the relationships 


ee 5 aeces 
sin | 5-7—x ] = cos x and cos x = /1—sin? x, the approximation 


(5.48) enables four-figure tables of this function to be evaluated with 
the aid of a calculating machine. In the same way, by using the higher- 
order convergents, we can evaluate tables of y = sin x with any num- 
ber of correct decimal places with the aid of a calculating machine. 

Since sinh x = —i sin ix, the expansions obtained for sin x lead 
us to the following expansions for sinh x: 


ere x x? 7x2 11x? 551x? 

cs ee ee ee || - 98 +4 198 —...° 
x 6x 60x — 7x8 5880x + 620x° 
1 6—x2 60—3x2 5880—360x?+ 11x4 


and 


: x 3x? 11x? 25x? 
sinh x = x + S 


10 4 AD” 2566 ce 


6x+x° 60x4+7x% 2520x4 360x? + 11x° 
6 60 — 2x? 2520 — 60x? 


x 
I 


13. Fractional approximations for cos x and cosh x 


The general form of the expansion as a continued fraction of cos x 
is unknown. Only a finite set of the partial quotients of the expansion 
can be obtained by Viskovatov’s method. For example, 
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oa cL. x 5x? 3x? 313x? 
14+ 2 - 6 + 50 me DG ah? sakes 
1 2 12—5x? 600 — 244x? 
1 24+x% 124x*% 600+56x*+3x4 
and 
cosx = 1 = x ae ele 
7 2+ 6 — 10 +126—-— ... 
L 2—x* 12—5x® 120—56x*+3x! 
1 2 I2+x? 120 + 4x? 


Since cosh x = cos ix, the above lead to the expansions: 


seen x 5x" 3x" 313x? 

“heer 0: Se Ge 50 + 126 — ... 
1 2 12+ 5x2 600 + 244x? 
1 2—x2 12—x? 600—56x?+3x4 

and ; 
cosh x = 1 + x x 3x" 13x? 

- 2 - 6 + 10 — 126+ ...— 
1 24x% 124+5x? 1204 56x?+3x4 
1 2 12— x? 120 — 4x? 


14. Fractional approximation for the error function 


The general form of the expansion as a continued fraction of the 
x 
error function erf x = (2/Vx) e~dt is unknown. Only a finite 


0 
set of partial quotients of the expansion can be obtained by Visko- 
vatov’s method. For instance 


en ee x2 392 739x2 
a —“T+ 3 ~ TO 4+ | re 


x 3x 30x — x8 210x + 110x7 
1 34+x% 304+9x% 210+ 180x7+39x4 
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15. Conversion of Stirling’s series into a continued fraction 


Let us take the Stirling series (see (6.509) and (6.516)): 


InI(x) = (=-7) In x—x+5 ln Int JO), 


2 
where 
ee B, B, Bon 

7 1.2x = 3.4x3 a ee + n= None t is 
and B,, B,, ... are Bernoulli numbers (see Chapter VI, § 2, sec. 1, 
1°): 

1 ] l l 5 
By= => B, 30° Be = > B, = 30’ Bio 66” 


By using Viskovatov’s method, we can convert the Stirling series 
into a continued fraction, the general partial quotient of which is 
unknown: 


2 2 


1 2 53 1170 22999 
+12x+ 5x+42x+ 53x + 429x + ...° 


In I(x) = (=-3] fie In 22 + 


16. Fractional approximation for the gamma function 


If we evaluate the coefficients in the expansion of the gamma 
function: 


LMd+x) = ys onx", 
n=0 


| ae =.) 
Co = 1, Cc, = oe (— 1)* cy Sp; 5, = Pe: (k = 2), 


S, = C =~ 0°57722 (Euler’s constant, see (6.56)), we obtain approxi- 
mately: 


I +x) = 1—0°57722x +0°98906x? -0°90748x* +0°98173x4— ... 
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On applying Viskovatov’s method to this approximation, we obtain 
in particular: 
T(i+x) = 1 +0°15141x% +0°24392x" 


T+07263x—0324568 — 7) = 6.49) 


This approximation is sufficiently accurate in many cases, as is 
clear from the following table: 


x | (1+) T(x) x (i +x) | T(x) 
—0°5 1-7725 1-7767 0-1 0-95135 0-95135 
—0°4 1-4892 1-4902 0-2 0:91817 0:91816 
—0-3 1-29806 1-29823 0:3 0:89747 0:89743 
—0-2 1-16423 1-16425 0-4 0:88726 0-88711 
—0-1 1:06863 106863 0°5 0-8862 0-8858 

0 1 1 0:6 0-8935 0-8927 

0:7 0-9086 0-9071 
| 1 0-994 


17. Fractional approximation for the logarithm of the gamma function 


Approximation of this function on the basis of Stirling’s series 
requires a knowledge of In x. However, it is possible to obtain a 
simpler approximation by starting out from the expansion 

oo ied Nyn 
Inf(l+x) = —-Cx+ ¥ ce (5.50) 
nm 


where s, = ) 1/m", C is Euler’s constant. On evaluating the 
m=l 


coefficients, we obtain approximately: 
In F'(1 +x) + —0°57722x +.0°82247x? — 0°40068x3 + 0°27058x4—.... 
On applying Viskovatov’s method to this approximation, we obtain 
in particular: 


— 0°57722x + 0°59769x? 


In I+) © 7o3R0dix— 0130282 * 
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Hence 


— 0°25068x + 0°25957x* 


Ig P+) © to 3Rodix— 0130282 


=x). (5.51) 


The accuracy of this approximation is clear from the table. 


x le T(1 +x) T(x) x lg (1 +x) T(x) 
~0:5 0-2486 0-2469 0-1 197834 197834 
~0-4 0:1730 0:1725 0-2 1-96292 1-96293 
—0°3 0-11329 0-11321 0:3 1-95302 1-95305 
0-2 0:066039 0-066029 0-4 1-94806 1-94818 
~0-1 0-0288268 | 00288266 || 0-5 1-9475 19479 

0 0 0 


18. Fractional approximation for the derivative of the 
logarithm of the gamma function 


In accordance with (5.50), the function 
Y(x) = cary g (1+ x) 
~ ax ms 


has the expansion 
P(x) = — C4 5.x—syx*+ 2... +(—1I)"* IS, x" 4+... 
from which it follows that 
W(x) ~ —0°57722 + 1:64493x — 1°20206x? + 1:08232x7— .... 


On applying Viskovatov’s method to the last approximation, we 
obtain in particular: 


— 0°57722 + 1:25687x 


TO 67TDBx—O 16670 ~ 7H) (5.52) 


W(x) = 


The accuracy of this approximation is clear from the table. 
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x | P(x) | T(x) x P(x) | T(x) 
—0°5 — 1-964 — 1-938 0-1 — 0°4238 —0°4237 
—0°4 —1-541 ~— 1-538 0-2 —0-2889 —0-2890 
—0°3 — 1-225 — 1-218 0-3 —0-1692 —0-1687 
—0-2 —0-9650 —0-9647 0-4 —0:0614 —0-0600 
—0:1 —0°7549 ~0°7549 0-5 0-0365 0-:0396 

0 —0°57722 —0,57722 


19. Obreshkovw’s formula 


A knowledge of the general form of the partial quotients of the 
continued fraction into which a given function can be expanded is 
not sufficient for a determination of the general form of the conver- 
gent of this expansion. Nevertheless, the general form of the conver- 
gent can be found in certain cases. The most general approach to 
this problem uses Obreshkov’s formula, which is one of the general- 
izations of Taylor’s formula. Obreshkov’s formula is 


ye a (x— mt = fx) = s < (x =r f(x) + 


PasQ verQ 


[. (x —t)™ (xy— DES ™+R+N() dt. (5.53) 


TE =n 


Determination of the rational fraction approximations of a power 
function with the aid of Obreshkov’s formula. We put x) = 1, f(x) = x" 
in (5.53), m being any real number. Now, 


Cr CY 

y Se ey 

xe aS = ee Tory ( 1) - 

~ yy een MO 

x ) Cink x” 
When m = k, this equation becomes 
iC: 

— 1) 

= cz, &~) 


xe y Ee (x— 1)” 1)’ : 


x 
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In particular, when k = 1, 


2—n+nx 


A ee ce, 
ee n+(2—n)x ‘s 


For instance, when x = 2 and n = 1/3, we have V2 ~ 14/11 = 1:273 
(the accurate value is 1°2599. . .). 

Determination of the rational approximations of the exponential 
function with the aid of Obreshkov's formula. We put x, = 0, 
(x) = & in (5.53). Now, 


In particular, when m = k, 


2k(2— 1)... (K4¢1)+ CL QA1) 2... (kW) F CE(2k— 2)... (REV ATE oo xt 


a ee 
2k(2k—1).. (K+ 1)— C21)... (k41) 84+ Cf(2k— 2)... (kD 2— 2. (DRE 
(5.54) 
Using the relationship 
e* — j 
tanh x = 
e* +] 
together with (5.54), we get 
Ch(2k=1) (2k—-2) ... (k4 Dx —C 8(2k=3) (2k— 4)... (KEV 4EI +... 
Gnhie ee 
K(2k—-1) 2. (KAM) KA C2 M2) (Dem 3) CEL EA ES (Vem 4)... K+ 1/B A+... 


On replacing x by ix in the last equation and dividing the right-hand 
left-hand sides by i, we get the general expression for the convergents 
of the expansion of tan x as a continued fraction. 

Determination of the rational fraction approximations of the 
logarithmic function with the aid of Obreshkov’s formula, We put x,>=1, 
f(x) = In x in (5.53). Now, 


w F (ore Ge &. ys Ck @-1 


Y y 
vel v rig One 6 Vx 


In particular, when m = a 


k cv (x—1)” ly 
Inx = k 1)’-2 
Py Cor | (- ae 7 ee ae ” 
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For instance, when k = 1, 


When k = 2, 


§ 4. Matrix methods 


1. Extraction of the square root by means of second-order matrices 


The theory of continued fractions is built up with the aid of the 
fundamental recurrence relations (5.2). It seems natural to consider 
generalizations of continued fractions, based on other linear recurrence 
relations, connecting the numerators and denominators of neighbour- 
ing convergents. Let us consider in more detail the relations 


Py = &Pp_y +BrOn—1 


oo 1 De ele 5.5 
0, = YnPn—1 + 9nQn—1 v ( °) 


These equations can be written with the aid of matrices in the form 


(or )=(G /4| ae (n=1,2,...). (5.56) 
0, 7 Yn On QOn-1 a oie 


We put «4, =a,8,=u,y,=146,=a(n =1,2,...). Relations 
(5.55) and (5.56) now become respectively 
Pr, 
On 


()-(.) G2) are oe 
Qn) \1 a/\Qn-s ee 


When a = 0, the process (5.57) is divergent. We shall therefore 


assume that a = 0. If lim P,/Q,, exists, it can be equal either to Ju 
i> oo 


aP,_1+uQn_} 
Pasa a aQn_ 3 


! (n= 1, 2, ...) (5.57) 


and 
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orto — Ju. Consequently the process (5.57) is divergent when a < 0. 
Let us use the notation 


we us Xj, Ju = Xo. 


We now have four cases: 


2) O<a < X; 


Ti—> oo n 
Pane Pon Pongt Pon-1 
——— = Xo Soe < ; 
Qon-2 Qon Qon+1 Qon-1 
3) x» < a <0, 
Pon-1 Ponti Pon Pon—2 
Se = ee eS ; P. 
Qen-1 Qon+1 Qen Qen-2 lim ——- = x. 
It-> cf Yn 
< X45 


Orn ae Oy 
l= nh 


For example: 
1) a> Xe, 
1 5 10 97 940 
4-7 4-6907 4-69043 
{22 < 4-69043; 


5 22\ 5 47 455 4409 
5 


2) 0O< a < X, 

5 27\ 5 52 26 265 2702 1351 
( ) 110 #5 #4451 520° 260 
5 5:2 5:19607  5-19616 
5-19607 < ./27 < 5-19616; 


—1 —15 —1:4 —1:416 —1-4137 
- 1416 < —./2 < —1-4138; 
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4Na<x, 
eS ) =2 7 = OT 
1-2) 1 =—4 15 — 56 
~2 —1:75 —1:734 —1:73214 
— 173214 < —./3. 


2. Solution of quadratic equations with the aid of 
second-order matrices 


Let us put ¢, =a, 8, = —4, ¥, = 1, 6, = a+p in (5.55). Relation- 
ships (5.55) and (5.56) now become 


P, = aPy_1— qQn-1 
On = © n-1 +(a+P)On-1 


(o:) = (esp lok) am 
Qn la+p/]\Qn-1 
If lim P,/Q,, exists, it can only be a root of the quadratic equation 


n—> co 
x?+ px+q = 0. Consequently, when p?—4g < 0, the process (5.59) 
is divergent, since the roots of the quadratic equation are complex 
in this case, while a sequence with real terms cannot have a complex 
limit. 

Let us write 
_ mervP-44 =P t= 4g 
— ) 2 — ° 

2 2 
1 

When a = z Gtx), the process (5.59) is divergent. When the pro- 


(5.59) 
and 


xy 


cess is convergent, we have four cases: 


P Pi 
lha>%x, »<~< =; 
x +%x. 
2) > 2 <a <X, lim — = x; 
Tl—> co n 
Posec: P If Pon 
anv-2 fan fants _ fan-i . 


Qon-2 Qon Qon+1 Qon-1 
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xXy+x. 
3) xy< ax ac ee 
Pos P Foes ee 
anm1 _ Santt _ yx < 128 ana 2 lim — = x,. 
Qon-1 Qon+1 Qon Qon—2 Nt} co kn 
sf P 
4Vax<x, “oH < =< x,; 
On-1 mn 
For instance, the equation 
x?+2x—1=0 


has the roots 


y2= - 1+./2 Or xX, —2414 and x, ~ 0414. 


1) a> Xe, 


ge%. (eee, 2 ae 
ot Br 2. a a= 12 


O05 O43 0417 


2) UE pie, 
7) 
-9 /9!\2 1 2 3 
=“ |) 2/T 2 5 FB 
0 05 0-40 0-417 
a Mees 
2 
~.9 (72 1\)22 5 = 2. 
sae 10/ 1 —2 5 12? 
—2 —2:5 —2:40 —2-416 
4) a~< xX, 
weg Poe. Dyes 10 ee ee ee 
SET Ny at) 24052 “T =24~ $13" 


—3 —2°5 — 2°428 — 2-416 
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3. The connection between matrix methods and the theory of 
continued fractions 


Let us find the conditions under which the equations (5.55) can turn 
into equations (5.2). For this, we replace m by n—1 in equations 
(5.55), find Q,_, and P,_, from the relationships obtained, and 
substitute them in equations (5.55). On introducing, for brevity, the 
notation «,_, 6,-,—Bn-1’n-1 = Gn-1v We get 


P, = (n+ Fee par a P56 (5.61) 
n— n— 
and 
4 ee 
0, = ( us zai + (oe nat On-> (5.62) 
Yn-1 Yn-1 * 


Equations (5.61) and (5.62) show that P, and Q,, can be taken as 
the numerator and denominator of the mth order convergent of a 
continued fraction provided that 


Yn 
Yn-1 


B Bn _ Yn 
ar é = ele 6 5 9 —— ene = 2 e 
ou a Bn-1 re 1+ %m Ba-1 Yn-1 v 


These conditions are readily written in the form 


On — On -_ On—1— On-1 _ _ a, — 0, 
Br Pred B, (5.63) 
Bn _ Poa _ near eect, 
Yn Yn—1l V1 
Hence the matrix 
| an Bn | 
V1 a, — Oy (5.64) 
——as a4 es 
By Bn nr By Ba 


is equivalent to a continued fraction, the partial numerators a, and 
partial denominators 5, of which are given by the equations 


a = cB a sie Cneie b, = = On-1+m—1 (n= 2). 
n—1 n—1 
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We can find from the relationships 
Ge ado) Ge) =r) 
Yo 4 0 Yo I 
i 7 @ = cae ie - ve 
% 6 1 ¥b9 + 0, by 


the zero and first partial quotients of the fraction. Hence the matrix 
(5.64), in conjunction with the matrix ey | , leads to the continued 
0 


fraction 


B. 
— —a,d 
K+ Py—Ag(M%% +6) PB, Pars — 24164) 


Zq+ 
—6 
By (B ae 
B n—1Ya—1 — ®n-19n-1 
ee (5.65) 
. + gon +n + eee 
n— 


EXAMPLE 20. The matrix (; 4 leads to V2 and is equivalent to 


the continued fraction 


Hagt © 2 ; 
2 De in Ae ee dae 
In the theory of continued fractions, contraction is performed with 
the aid of the fairly complicated formula (5.9) and analogous formu- 
lae. Here, it is performed much more easily, with the aid of squaring, 
cubing, etc., the matrix. We have: 


1 2\/1 2 3 4 
= », 4 = 2-4-3-3= —-l, 
1 1/\1 1 2 3 


b, = 3+3 = 6 (n = 2). 


The zero and first partial quotient of the new continued fraction have 
to be found directly, and not on the basis of this matrix, from a 


knowledge of the first convergents of the initial expansion for . 2. 


CONTINUED FRACTIONS 293 


We get 


2 1 l 
V2=1l+e_3_G_ | 


On using the cube of the initial matrix, we get 


(2s): )-G 9): 


J/2 = eee i a 
= 12+14+4 144+ ...° 


4. The reduction of quadratic surds to non-periodic continued fractions 
by means of second-order matrices with variable elements 


The results of the previous section enable us to obtain as many 
expansions as desired of irrational square roots as non-periodic 
continued fractions. 

EXAMPLE 21. The matrix 


{1 2a4+)) 
4 +1 ] ) 
satisfies conditions (5.63). In addition, it leads to the equation 
Pr ms Pai t2(n+ IQn-1 
Q, (2+1)Paiit+Qn-1 7 
from which it follows that lim P,/Q, = J/2. The equivalent continued 


l—> oo 
fraction (5.65) has the form 
2 21 8.17 15.31 24.49 
V2 = Poe sos & a a ae ae ee cones 
(n? — 1) (2n* — 1) 
ee 2n +1 +... 
Similarly, by starting from the matrix 


n (n+l) 
& n ), 


we get the continued fraction 


feat 2 (n? — 1) (n? +-2n— 1) 
i ie” Sar ee Seer 2n? — 1 oe kes 
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5. Extraction of the root of any rational power by means of matrices 


Extraction of the cubic root with the aid of matrices. Let us consider 
the three sequences {P,,}, {Q.,}, {R,,}, the terms of which are connected 
by the relationships: 


Py = GPp_yt+tQn_y + tRy-1, 
On = Pai +4Qn_1+tRy_1, (n=1,2,...). (5.66) 
Ra = Tn-1 +On-1 +aR,_ 


These relationships may be written with the aid of matrices as 


y ae at t){Py_, 
Q,{=)1 a tl) ]Qn-1 (5.67) 
R, 1 1 aj) \Ry-, 
Let x = lim P,/Q, and y = lim Q,/R,, exist and be finite. Now, 
i—> oo TN =>} oo 


ga. yas 


EXAMPLE 22. Let a = 1, t = 2. Then 


ae 1 5 19 73 281 1081 
1 1 2 1 4 15 58 223 858 
1 1 ] 1 3 12 46 177 681 


3/4 approximately 1 1°67 1°583 1-5870 1-58757 1-58737 
$/2 approximately 1 1-33 1-250 1-2609 1:25989 1-259912 


It is well known that °/2 ~ 1°2599210, 9/4 = 1°5874011. 

By utilizing the square, cube or a higher power of the initial matrix, 
the convergence of the process can be strengthened as desired. 

Extraction of the fourth root with the aid of matrices. We generalize 
relationships (5.66) and consider the following equations: 


Py = QPy_1+1Qn_1 + tRy-1 +tS,-1, | 
QO, = Pa_1 t@Qn-1+ tRn-1 +tSy—1 

Ry = Prov tQn-1 t+ @Rg-1 +tSq-1, | 
Sn = Pn t+Qn-1+ Rn-1+@Sn-1- 


(n= 1,2, ...). 


We can write these with the aid of matrices as: 
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P att t\ {Pr_, 
Qn} _Ji @ t t){Qn-y 
Ra 1 1 at] | Ry, 
Sn 1 1 I as \S),_, 
Now, 
: Pr 4 43 : n 4/,2 Rn 4 
lim — = 4/f3, lim 2 =4/P = Jt, lim ee 
n—> oo Sn Tl —> co Sn n— co Sn 


if these limits exist and are finite. When a = 1, we have the matrix 


1 ¢ ¢ t\ 1 L4#3t 1412430? 14314431227+2° 
1 i1¢ ¢}] 1 242t 34+12t+2? 4+ 40t +201? 
1 11¢] 1 34t 6+ 108 10 + 442 + 100? 
111% 41 4 10+ 6t 20 + 401 + 4¢?. 


Hence we can obtain in particular the inequalities 


024.1243 Z Ji 6t? + 10f 


61410 falas | StS) 
6t? 6 +108 10¢ 17412¢+3 
faclwd3 = sis éto “= %. 


The domain in which we can apply these approximations is clear 
from the following table: 


£74+12¢+3 6? +108 
. 6¢+10 Jt 2412843 
1 1-000 1-000 1-000 
2 1-409 1-414 1-419 
3 1-714 1-732 1-750 
4 1-971 2-000 2-030 
5 2-200 2-236 2-273 
6 2-413 2-449 2-486 
7 2-615 2-646 2-676 
8 2:810 2-828 2-847 
9 3-000 3-000 3-000 
10 3-186 3-162 3-139 
11 3-368 3-317 3-266 
12 3-549 3-464 3-381 
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Extraction of any rational root with the aid of matrices. It may be 


seen, on generalizing the method above described, that the nth-order 
square matrix 


enables approximate values to be obtained for 


For example, to evaluate V4, we only need to carry out the fol- 
lowing working: 


122222 2) 1 13 127 
112222 2/1 12 115 
1112222] 1 11 104 
111122 2/1 10 9 
111112211 9 85 
111.111 2)1 8 77 
i11%111 2) 1 7 += «7 


In particular, 4 ~~ 104/85 = 1°223 or V4 ~~ 85/70 ~ 1:214. The 
accurate value of this root is 1°219.... 

The convergence of Euler’s algorithm. The method of extraction of 
roots of any rational degree with the aid of matrices was first pro- 
posed by Euler (though not in matrix form). The conditions for its 
convergence were recently obtained by L. D. Eskin. In particular, he 
showed that Euler’s algorithm is convergent for any t> 0 provided 
only that the zero approximation be chosen by a reliable method. 
Furthermore, Euler’s algorithm is convergent for complex t, which 
enables it to be used for approximate extraction of roots of complex 
numbers. 
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6. Solution of cubic equations by means of matrices 


The matrix 
4, Qo yy 
Qo, Ao Ap (5.68) 
Qs, 43g G33 
eads to the equations 


x= AX + Ae + Ais and y= Qn1X + Goay + Aas . (5.69) 
Ag)X + Aso) + A33 A31X + Asa) + As3 


On eliminating x from these equations, we arrive at a third degree 
equation in y. Consequently, the matrix (5.68) can serve, when the 
corresponding process is convergent, for approximate evaluation of 
one of the roots of a third degree equation. 

We can readily obtain from (5.69) the equations 


ae: (py — @g1)X + (dog — 23q)Y + Go3 — Aa5 


Q A31X + Asay + Ags 
oe (211 — Qp1)X + (Ay2 — Gg9)¥ + 213 — dog 
= ye, 
A31X + Az2y + A239 


Let us require that the condition y* = x be satisfied. For this, it is 
sufficient that the equations obtained take the form 


ra == J (dos a a. yy 
. " A31X + Asay + Ags ue A3)X + Ago) + A33 


Now, 
Go, = 431, og = A390, ayy = Aa3, Ag = AQo3, 
G19 — Qgn = Ao3 — G33. 
Matrix (5.68) takes the form 
Gy, G92 +413— 433 Qj 


yy Ag 3]. (5.70) 


It leads to the equation 


Ay y? + (Gog — 243)” + (Ag — Ge2)¥ — ay3 = 0. (5.71) 
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Let us put, in particular, a,,; = ad. = 1 and let us write a,,—1 = p, 
Qi, = —q. The matrix (5.70) takes the form 


1 -p-g -g 
l l —q]|. (5.72) 
] l pt+i 


It leads to the equation 
y+pytq=0. 


When p = 0, g= —1, the matrix (5.72) becomes the matrix for extract- 
ing the cube root. 

EXAMPLE 23. Let us apply matrix (5.72) for obtaining approximately 
one of the roots of the equation x*—x—1]1 = 0. We have 


12 1) 1 4 12 37 114 =6351-—Ss«1081 
1 1 1} 1 3 9 28 86 265 816 
1 1 0) 1 2 7 21 65 200 616 

1 1-5 1-285 1°333) 1-292 1-325 1-324 


Notice that the convergence of this method is only rapid when 
the equation does not possess two roots close to one another in abso- 
lute value. 


7. Recurrent series. The Bernoulli~Euler method 


A power series )’ a,x”, the coefficients of which, as froma certain 
r= 
n, are connected by the same linear relationship, is described as recur- 


rent. The following theorem holds: the necessary and sufficient condition 
for the sum of the series 7 a,x", convergent for |x| ~< 1, to be a rational 


function of x is that the series be recurrent. 

D. Bernoulli and Euler applied recurrent series to the solution of 
algebraic equations. Cauchy provided the basis of the method by 
indicating that, if x, is the root of least absolute value of the polynom- 
ial O(x), the radius of convergence of the series 


n — P(x) 
2 = Q(x) ’ 
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where P(x) is a polynomial having no roots in common with Q(x), 
and the degree of which does not exceed the degree of Q(x), is given 
in accordance with d’Alembert’s test by the relationship 


lim An+1%1 = 
lh—> co an 
from which it follows that 
an 


I> co Qn+1 


For instance, Euler solved the equation x*—3x+1 = 0 by using 
the following expansion: 


l = 2 To | 5 
+ 622x® + 1791x7 + 5157x8 + 14849x° 4+ 
$42756x9 4... = ¥ a_x”. 
n=@0 


Here x, = fares G,,/dn4 1, Where x, is the root of least absolute value 


of the squation x3—3x+1 = 0. The convergence of the process is 
clear from the following table: 


ay 


Qn+1 


0-333 
0-333 
0-346 
0-3467 
0°34722 
0-34727 
0-347292 


NANA ON & WW — 


On replacing x by 1/x, the same method can be used to find approxi- 
mately the root of greatest absolute value of the equation Q(x ) = 0. 
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The convergence of the Bernoulli-Euler method is also only rapid 
when the equation does not have two roots close to one another in 
absolute value. 


8. Connection between the Bernoulli—Euler method and matrix methods 


Let us find by the Bernoulli—Euler method the root of least absolute 
value of the equation x*+ px+g = 0. For this, it is sufficient to expand 
1/(¢+px+.x*) as a recurrent series. We have 


I 


G4pxt+x> = Ag + Ayx + Agx? + wince: © 


On equating coefficients of powers of x, we get 
] 
Ay = q QA, +pAo=0, gAo+pA,;=0. GA3+pA3+Ap = 0. 


and in the general case: 
QA, +PAn-1+An-3 = 0 (n = 3). 
This relationship can be written as the matrix equation: 


0 q 0 An-s GAy-» 
0 0 Q| | An-2| = | GAn-a 
—1 0 ae An-1 gA,, 


But this equation gives only one new coefficient A,, while the two 
preceding ones are repeated. Ontaking the cube of the matrix com- 
posed of the coefficients, we at once obtain three new coefficients: 


0 q 0 $ An-3 PAn 
0 0 q Ayo = PAnai ’ 
-1 0 —p An-\ PAnse 


g* 0 pq An-3 g?An 
— pq gq? —p'q An-2| = Ans 
p> —pgq pr+q*} \An-1 GsAnie2 
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On applying this method to the equation x*—3x—1 = 0, we get 


—1 O 3) 1 26 622 14849 
—3 —-1 9} 3 75 1791 42756. 
—9 ~3 26) 9 216 5157 123111 


An even higher power of the initial matrix can be taken; this still 
further strengthens the convergence, though not all the coefficients of 
the recurrent series are utilized in this case. The elements of the matri- 
ces obtained can be divided by the same number, since we only need 
the ratios of neighbouring coefficients. But the series obtained here 
will in general differ from the recurrent series, into which 1 /(¢+px+x*) 
is expanded. 

On replacing x by 1/x, the same method can be used to evaluate the 
root of greatest absolute value of the equation x°+px+q= 0 (if 
the corresponding process is convergent). 


9. Solution of higher degree equations by means of matrices 


We can use a method similar to the above to form nth-order 
matrices that can be employed for the approximate evaluation of 
the roots of an mth-degree equation. For example, the matrix 


k la, QO... O 0 0 0 0 
0 k lagen 0 0 0 0 0 
0) 0 0 la, 0 0 0 0 
0 0 0 k la,, 0 0 0 
0 0 0 0 k la, O 0 
) 0 0 - awe “O 0 k 0 lan, 
—lay —la, —lag... —la,_s —la,_4 —lan_y kK—la,_, —lan_, 
0 0 O° sace. “0 0 0 lay, k 


can serve, when the corresponding process is convergent, for approxi- 
mate evaluation of one of the roots of the equation 


Anx” +dy_yx™ 1+... +ax+a) = 
For example, in the case of the equation 


x* — 8x84 x7-—x+1 = 0, 
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we obtain on putting k =] = 1: 


110 0, 1@Q1 2 4 li 58 455 
010 1} 1(2)1 2 a 47 397 = =3500 
—-1 1 9 —1] 1 (8) 4 35 310 2753 24463 217403 
00 1 IY 1(2)1 5 40 350 3103 27566 
l 4 7 7:15 7-866 7:8837 7-8866 


The exact value of this root is 7°8873... . 


10. The idea behind Jacobi’s algorithm 


Euler posed and partially solved the problem of finding the solution 
in integers of the equation a,x;+a_x2+a3x3 = 0. Jacobi posed the 
analogous problem for the equation 

Ay Xy +AgX_ + coe +AyXy == 0 
and developed for this purpose a special] algorithm, which is a gener- 


alization of the algorithm of continued fractions. In particular, Jacobi 
assigned to this algorithm the following form: 


Unt = Ya—Prllns 
Yn+1 = Wa- Inn» 
Wn+1 = Un- 
Here, p, and g, are positive integers, chosen in such a way that 
Un,, and y,,, are the least possible positive numbers. With the aid 
of the numbers p, and q,, we form the following relationships: 
A, = YnAn-1 +PrAn_-2 +Ay_3; 
By = QnBn-1+PnBn—-2 + Bn-a> (5.74) 
Ch = AnCn—1 +PnCn-2 + Ch—3, 
We suppose that 


(5.73) 


A_s A_y Ay 1 0 0 
B_. B_., Bj=l]0 1 0 
C5 C4. °C, 00 1 
In this case, when Jacobi’s algorithm is convergent, 
An at lim B mal 


n 
no Cr Wy n>eoCnr Wy 


CONTINUED FRACTIONS 303 


Jacobi’s algorithm enables us to find fairly small integers 4,, B,, 
C,,, approximately proportional to the given large numbers 4, ¥,, wy. 
EXAMPLE 24. Let us solve approximately the equation 


xiyiz a 49:59:75. 


We have, on using Jacobi’s algorithm, 


N Un Yn Wn Pn Gn An Bn Cn 
—2 1 0 Q 
—1 0 1 90 

0 0 0 1 

1 49 39 75 1 21 21 =421~«421 

2 10 26 499 2 4 4 5 6 

3 6 9 10 1 1 5 6 8 

4 3 4 6 1 2 15 18 23 

5 1 0 3 0 3 49 59 75 

6 0 0 1 


Thus, for example, 5: 6: 8 + 15: 18: 23 = 49: 59: 75. 

The order of filling up this table is as follows: we first evaluate 
u, =49, vy, =59, w, = 75 and A,, B,, C,, with m= —2, —1, 0. Next, in 
accordance with algorithm (5.73), we evaluate p,, q1, Us) Ya, Wa. Then, 
with the aid of relations (5.74), we evaluate A,, B,, C,. Next, in accord- 
ance with algorithm (5.73), we evaluate pa, qa, Us, V3, W3- With the aid 
of relationship (5.74), we evaluate A,, B,, C., and so on. 


CHAPTER VI 


SOME SPECIAL CONSTANTS 
AND FUNCTIONS 


THE present chapter contains information on real constants and 
some real functions commonly encountered in analysis.t 

Our treatment must take into account the fact that differing defi- 
nitions are current in mathematical literature. For instance, the 
generating function of a sequence of functions is usually defined as 
the function of two variables f(x, y) for which the relationship 


f(x,y) = » P(x)", 


is Satisfied in some domain of the x, y plane, 1. the ¢,(x) are the 
coefficients of the expansion of f(x, y) as a series in powers of y (cf. 
the definitions of the generating functions of Bessel functions and 
Legendre polynomials). In other cases, f(x, y) is called the generating 
function of a sequence if 


{ay = roe y 


(cf. the definitions of the generating functions of Bernoulli and Euler 
polynomials). 

There is also a lack of uniformity as regards the notation for 
various functions. In such cases the different notations will be quoted, 
though only one of them will be utilized. 


{ Information concerning functions of a complex variable will be given in a 
later volume. 
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§ 1. Various constants and expressions 


1. Some well-known constants 


1°. The number 2: 2 = 3°14159 26535 89793. .. 

The number z made its appearance in connection with the calcula- 
tion of the length of a circumference by finding successively the 
perimeters of the inscribed and circumscribed regular polygons with 
2” sides, 2 is a transcendental number. 

Some approximations for the value of z: 


% = 22/7 (Archimedes’ number); 
mw = 355/113 (Metsiev’s number). 


Some representations of 1 as series and products. On putting x= 1 in 
the power series expansion of arc tan x, we get the Leibniz series 
4 1 1 1 


ee ee ee _.1\2 
rn ] 7 +5 zt +. + ( 1) 


1 
Karte: OD 


With x = 1/J 3, we get from the same expansion 


Tt I 1 1 1 1 1 1 
as aliggts3-7 et m8 ). (6.2) 


Since 7 = 16 arctan (1/5) —4 arctan (1/239) (Machin’s formula), 
we have 


1 i121 2121 0321 ~=70 21 
wa (ttoet htt t 


] 1 1 
—4 (a5-3 a +.. ). (6.3) 


Wallis’s formula is 


Te. ods (2Qn)!! |? 1 
5 = im | aoa | 5 iy -) 


As a continued fraction: 


I lL Ae .2? n* 


res geo ee oe ete 9) ee (e) 
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Other relationships are: 


IU = l 
4 = 2 ) we: 


372 (4n+ 1)(4n+ 3)’ 


n=0 
fe et = Eou—2 
(2n)* 


O(—1)"Eam 


+ (ppmte 


m(—1)!1By-. 1 O(—1)™ Bymae 
+ m1 Det Ome Ome” 


res 
Te 2 
2 f2v24+/2V24+V24+/2 
2 el IU 
ra a Ie : Qnt+1° 
4 16" 02.22.35 '° 22.32.42 ° 324852 oct’ 
x ee | 
6 x n 
a US 1 
8 ae (2n + 1)? 
m2 1 
= 5 (“ets 
12 cat ne 
2 


(6.6) 
(6.7) 
(6.8) 
(6.9) 


. (6.10) 


(6.11) 


~ (6.12) 


(6.13) 


(6.14) 


(6.15) 
(6.16) 
(6.17) 


(6.18) 
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372 eo l 
en ay See) eas (6.19) 
32 Pa (4n? — 1)° 
2 1 1 | 1 
6 = ate te tat :--- (6.20) 
2 
an? 1 l (6.21) 


756 ~~ Ot yazese + Ba527a tT Gayaga Tt 


Inequalities connected with the number x. Vf a,=0 (n=1, 2, ...), 
but not all are zero, we have 


co 4 oo oo 
(s a sw y a, y wai, (6.22) 
n=l nal n=1 


* being the best constant in the sense that there exists a sequence a, 
for which equality is attained. If f(x) =0, f(x) #0, fEL*(0, ~), 
xf €L, (0, ~), we have 


4 
\- f(x)dx> = Py | F*Xx) Py [sree , (6.23) 
, JPA, 


where 77 is the best constant in the sense that there exist f(x) for 
which equality is attained. 


Integral forms of x: 


nt 4 - tan x 

en {. - dx. (6.24) 
1 -° sin x cos mx 

pee (6.26 

py) — ; x2 x. Ve ) 


5 iE = |. sin (x?) dx = | ~ cos (x?) dx. (6.27) 
0 0 
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2°. The number e: 


ae 
— 


MATHEMATICAL ANALYSIS 


°° sin a *” COS X 


we ee 


n =| In x dx 
6 ‘ x—] 
me 1 In x dx 
8 ; x*—1 


Z|. In (1 +x) dx 
0 


x 


e = 2-7182818284 59045... 


Euler’s number e is defined as the limit 


as = 
e= lim (1+2) = lim (l+a)*°: 
n a—>0 


h-—> co 


e is a transcendental number. 


ax. 


(6.28) 


(6.29) 


(6.30) 


(6.31) 


(6.32) 


(6.33) 


(6.34) 


(6.35) 


(6.36) 
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Expressions for e, e?, e1, (1+e)? as series and products: 


m+(m-— } 
Pm+1 = 1+ mp,+ mY p+ ++ +Pm; 


y=1, Py=2, P3=5, py= 5, PeH 92,6 ce 


i 1 1 
_ 2/4)? /68\8/ 10.12.14.16 \8 
= 7.3 5.7 9.11.13.15 ake 


1 & 2"%(n+1) 

2 Nee 

: ye nt 

242" 
(tera y 


as ORG) 


—-}|] bs 

a "(at kd) 
nN khmO 

2. 2 J 


Ss FAG 4510 oe DON) bos 


(continued fraction). 
Some inequalities. When 0 = t Sn: 


V/a(a+d\(a+2d)... [a+ (n—1)a] 
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(6.37) 


(6.38) 


(6.39) 


(6.40) 


(6.41) 


(6.42) 


(6.43) 


(6.44) 


(6.45) 


(6.46) 


(6.47) 


(6.48) 
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When u, > 0: 
n 2 
Ox 1-2 (1-7) eee (6.49) 
n n 
y NV lytle uy, 
ee se. (6.50) 
D Un 
neal 
lim sup 271 o 6 (6.51) 
TN%—> oo U,, 
Minima: 
; _ =e, (6.52) 
=x< oc 
sue ne (6.53) 


The number e is the base of logarithms with which the inequality 


is Satisfied: 
log ax = x—1 (Ostrogradskii). (6.54) 


The functions e* and e~* are defined as the limits 


e= = lim (142) e-* = lim (:-3y" (6.55) 


Ti—> oo rY— oo 
3°, The Evler—Mascheroni constant C: 
C = 0-5772156649 015325... 


The Euler—Mascheroni constant C is defined as the limit 
: m j 
C = lim ( Y ie mm) (6.56) 


the existence of which follows from the convergence of the series with 


general term 
n+1 


g(n) = =— | t~1 dt, 


n 


It is unknown whether C is rational or irrational. 
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Integral forms. Since 


] 1 1—r™ = m y m Ls 
l+s+-- tee fae [| € >| P dy 


we have 


ee Inm = iia . y71d ‘ i= " y-ldy 
n=1 1 0 m y ; m 
from which we find, on passing to the limit, that 


C= ik —e-V)y—1 dy - [ew dy (6.57) 
0 


1 


1 
C= [ (1 sient = ot) t—1 dt. (6.58) 
0 


It follows from (6.58) that 


or 


C= {to —e-')-1— ¢-1] e-! dt, (6.59) 
0 
Other integral forms. 
Gee | vent in t dt. (6.60) 
0 
C= are : dt (6.61) 
— yy| me l-t | " 

= ] dt 
C= oF (cos ar) T (6.62) 

- /sint 1 dt 
C=1- i ore an) (6.63) 


t 
== l at 
= — pot \__ 
C ( ar e ) ze (6.64) 
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c=|"(x et) 
P e'— ] t 


1 ] 
C= -| In In — dt. 


0 


C= | (3 arc cot f— om) 2 as p. 
0 a f 


C= {- (= srceotr— cos p) dt—In p. 


0 


2 oo 
C= | See, 
0 t 


ay 
The asymptotic expansion Is 


me] ] 


o =2 8 mt om + Tam T0m't °° 
ob Bon ] fa) Bon+2 ] 
"  2n min 2n-+2 mente? 


Infinite products expressible in terms of e and C are: 


1 


= em li 
9 aes apes m 
fee T{ 1+— 
Nn 1 n 
e lim — e 
wide 
1 
Fs ee ar ae Lene a 
og tan l-t J-f °C’ 1-9 


4°. Catalan’s constant G: 


G = 0-91596 55941 772190... 


1 1 
—_— Aitgtgte + ton m)+in m 


0<6 <1, 


(6.65) 


(6.66) 


(6.67) 


(6.68) 


(6.69) 


(6.70) 


(6.71) 


(6.72) 
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Catalan’s constant G is defined as the number 


1 arctan x 
G =| ——— ax. 


0 x 
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(6.74) 


An expression for Catalan’s constant as a series can be obtained 


by expanding x~! arc tan x in (6.74) as a power series: 


co 60U dL 
G= 2 Gm+i 


Other integral forms are: 


n/2 
G=5| t dt 
2 0 


sin t 
4 m/4 
G= Gin2+2 | t tan ¢t dt. 
4 0 
7 m/4 
= ~Fin242[ t cot t dt. 


0 


2/2 
+G= -FIn2+ iis 


0 m/4 t dt 
ao aos > (sin t+cos f) sin t” 


wiA 
G = ees 2-2| In sin t dt. 
2 0 


1 1/4 
G = — 75 In 2+2 | In cos ¢t dt. 
0 


] 2 1 
tG=2| in (1+cos t) dt+ — In 2. 
2 I, 4 


2/2 nx 
G= | In (1 + tan t) dt— > In 2. 
0 


1 Int 


G = hee dt. 


$+ Intde 


0 VI-# 


I 


» (cos t+sin ¢) sin t” 


(6.75) 


(6.76) 


(6.77) 


(6.78) 


(6.79) 


(6.80) 


(6.81) 


(6.82) 


(6.83) 


(6.84) 


(6.85) 


(6.86) 
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G = = In2 +[" (Gearetanr) 5 
0 


T 1+t dt cL 
G = 2 [" (Garctant T-t ile 4 
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c=" In (1+) —3 = In 2. 


1 In(i+t) 
G= -2m2-—| 
sas Nev te 


_ 2 In (1 —t) 
G= gz in2 - i¢?? dt. 


370 1 1+? dt 


0 


l+t 


- arc cot tf ALA 
G — [ age tg ee 


1 arc tan ¢ 
C= | a tg In 2. 


Gz a aL 
, I-t 


G= see ” (are tan ae 
16 44, 2/iee 
Si he 1 f@ t dt 

G = —+— arc cot rf)? ; 


Itt 14270 


G= +7 In 25 | kl Pa 
0 


(6.87) 


(6.88) 


(6.89) 


(6.90) 


(6.91) 


(6.92) 


(6.93) 


(6.94) 


(6.95) 


(6.96) 


(6.97) 


(6.98) 


(6.99) 


Expressions in terms of complete elliptic integrals (see (6.380) and 


(6.381)): 


1 fl 
= al K(k) dk. 


Gx [20 dk —1. 
0 


(6.100) 


(6.101) 
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2. Soumne merical expressions 
1°. Factorials. When 7 is a positive integer: 


BES ND sac My 


By definition, 
O! = 1. 
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(6.102) 


The gamma function is a generalization of the factorial (see § 4, 


sec. 5). 
When m is a positive integer: 


(2m)!! = 2.4.6... 2m. 
(2m+1)!! = 1.3.5...(Qm+1). 
(2m)! = 2™m!(2m—1)!! 


(6.103) 
(6.104) 
(6.105) 


The number n!! is called the double factorial of n. Expressions for 


factorials, inverse factorials and their sums: 


2.9 ! 
nni w&, m(m+1)...(m+n) | 
nr 
(n+1)! = 14+ ¥ kk! 
k= 
a -1 
y asi = ate = cosh 1 = 1-54308.... 
Nm T . 
oo ] e—e-} 
y Gnaiy! = 7 = sinh 1 = 1:175201.... 
n=0 : 
oo a | 7 
Sar = cos 1 = 0°54030.... 
n=0 
(Dt = sin] = 084147... 
n= — e 


oe aint = [,(2) = 2:27958530.... 
n=l * 


= 1 
vs ni(n+ 1)! 


= 1,(2) = 1-590636855... . 


(6.106) 


(6.107) 


(6.108) 


(6.109) 


(6.110) 


(6.111) 


(6.112) 


(6.113) 
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= I 


 aintbr = e@): (6.114) 
yore = Jy(2)=0-22389078 .... (6.115) 
p> — = Jy(2) = 0-57672481.... (6.116) 
De eon = J,(2). (6.117) 


Inequalities and asymptotic formulae: 


Seyn(2) Srseda (2) (6.118) 

res (3) (6.119) 

aa set (6.120) 

aes Jam (2) (+a - ) (Stirling). (6.121) 

(2n—1)!! = J Cnyte "tim, 10,| <1. (6.122) 
n+ 


2 
ae 0 
nix /2n aye e 24n+12 (Gauss). (6.123) 


A formula for the logarithm as a factorial: 


n n n 
In 7! Te (a + | + | +.. ), (6.124) 


where the summation is over all primes p not exceeding n. ( [x] is the 
integral part of x. See § 3, sec. 1, 3°.) 

Divisors of a factorial. The greatest index with which a prime p ap- 
pears as a factor in 7! 1s 


Bub sce | (6.125) 


where p® = n, but p*t!>7. 
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For example, the highest power of the number 2 by which 50! is 
divisible is 
50 50 50 50 50 
*[7-( Ha} [2)-° 


Thus 50! is divisible by 2*’. 
2°. The Kronecker delta 6” (or 6,,,,) is defined by 


llnw=m 
ém =)” | (6.126) 
‘ ‘0 n << m. 
The integral form is: 
n 
om = | Pn Pn(X) dx (6.127) 


where {¢,(x)} is a system of functions orthonormal in [a, 5}. 
For instance, 


6m = = cos mx cos mx dx. (6.128) 


: ‘ ; n : 
3°. The binomial coefficients or Cy", where n is any real 
m 


number and m is a positive integer, are defined by 


(") Oiled EE aa J (6.129) 


m m! 


When n is a positive integer: 


n n! 


The beta function is a generalization of the binomial coefficient 
(see § 4, sec. 5, 2°). 
Some relationships between binomial coefficients (m, m integers): 


(7) =0 for n>0, m>n. (6.131) 


m 
n n 
@ — For (6.132) 
n n n+1 
(")e(qnr)= (Mth) eas 
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n+l n+k n+1+k 
eo )e( k ) (6.134) 


nee m(Z)ec ("7 ): (6.135) 
n+ 2n 
r - aes CD baa (6.136) 


)+ Ree a (6.137) 
)+ sce ee 2 (6.138) 


Sprints +(.-1) = 222-2 (mis odd). (6.139) 


2% 
+ > +... (1) = 222-2 (is even). (6.140) 


nr 
= (3—1)"+1 5 sin teal . (6.141) 


3 
J+ sag (242 208-3). (6.142) 
3 3 
)teoe 5 (242 cos ——) (6.143) 
)+ tate 3 (242 = “). (6.144) 
Jaen = aii cos =). (6.145) 
n | a4 

= ws -1 : kale : 

+ 5 ie 5 (> + 22 sin =) (6.146) 


n 1 ae 44 
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(3) (9) (9-H). 
G)-Eh(2)(c)eontod. we 
rue om 

(7)+2(7)+3(3)+--. +@40(")=otazes (6.151) 
(1)-2(3)43 (3)- _ +(e (*) =0(n #1). (6.152) 
1/n\ lfn nO ae n 
x) -4()>o+ BG) ext 
- ee i Sn l n Qn+1i_ ] 
(a) eh Operate 2) =F 
- 2/n 3/n Qn+1 /n 3n+1_. } 
(SSC) 3G) Ba). as 
n l/[n l/n (=1) 2 (7 
()HC)4(0)- SEG) 
= 1t p+. de. (6.156) 
n+1 n n—1 2 
("2") [Ca++ +2) > 
a= 124274... +7. (6.157) 
2) B)() (eB) )(8)-0) 
n\/[{n n n n La 
(o)(e)H(t)(ati + +(e) (&)- 
_¢ an \ _ (2n)! 
=(,-&) = GBIF OT (6.159) 
2 2 2 
ORO ORG aaa 


320 MATHEMATICAL ANALYSIS 


0) ee es 


2n+1\2 /2n4+1 2n+1\? 

( 0 a e y+ (hn) = 0. (6.162) 
n\2 n\2 n\? 
ya) trea 


= (2n—1) nt) = Gene (6.163) 


Binomial and polynomial formulae: 


(ates = Ys ee (6.164) 
Vitveomn V,!, ! 
(a, + a,= eee +a,)" = 
n! 
az ————, aad? ... ane. (6.165 
Vr thet... ¥en V1 !v,! wee V,! yo p ( ) 


Some identities in connection with binomial coefficients: 


ae ( _ a: (6.166) 
Daa x) =3h= (I - a4 x. (6.167) 
n 2 = 
z,( aa :) (;,) — xk CT) 6.168) 


The Bernshtein polynomials B,(f) of a function f(x) are defined by 
the relationship 


B,(f) = om ( _ xh(] ~ x)n-h f (=) (6.169) 


If f(x) is continuous in the interval 0 = x < 1, the sequence{B,(f)} 
is uniformly convergent to f(x) in this interval: 


lim B,(f) = f(). (6.170) 
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Asymptotic formulae. 
on Jan On 
— }~ —es 6.171 
' ae ale. (6.171) 
1 ary 
m"* 2(n—m) 2 
knead 
mn fn\k 2knf2\ 2 
> (4) s le) (6.173) 
nk+l++ 


nk +l (kK-—1)"/ k a 
(2) Mee 


("7')- TEs ly Seat PASE) CN) 


Fibonacci numbers and the golden section. The sums 


i _ 
m= > (” rae (6.176) 


are connected by the relationships 


The numbers u, are called Fibonacci numbers. Binet’s formula holds: 


CE) ° (6.178) 


The following are consecutive values of the Fibonacci numbers: 


k,n = 


Uy, U», Ugz5.0- 


big Mig Op Op Oy 35 ly eee 


The Fibonacci numbers appear in the expansion as a continued 

1 1 
lt it... 
have the form u,/u,,(n = 1, 2,...). 


1 = 
fraction of the number — (J 5 —1) The convergents 
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1 
The number « = 7 (/5 ~1) 1s occasionally called the number of 


the golden section, It is defined as the mean proportional between 
1 and its complement to 1: 


a? = 1(1l—~). 


It was supposed in classical aesthetics that, for instance, the rectang- 
le with ratio of sides «, or the ellipse with ratio of axes a, were partic- 
ularly pleasing to the eye. Hence the name golden section. 


§ 2. Bernoulli and Euler numbers and polynomials 


1. Bernoulli numbers and polynomials 


Special number sequences, e.g. Bernoulli and Euler numbers, prove 
useful for obtaining power expansions of numerous functions. 

1°, The Bernoulli numbers B, (n = 0, 1, 2, ...) are defined as the 
coefficients of the expansion as a power series of the function r(e'— 1) 
for |t| < 27: 


= > B,—. (6.179) 


These numbers were first mentioned by Johann Bernoulli (Ars 
Conjectandi, 1713), inconnection with the problem of summing powers 
of the natural numbers. The numbers B figure in the power expansions 
of the functions tan ¢, tanh ¢, t cot t, t cotanh ¢, etc., in the Euler— 
Maclaurin summation formula, in the asymptotic form of Euler’s 
gamma function. 

There is no one accepted notation for the Bernoulli numbers. In 
certain works, B,, is used to denote what we denote in the present sec- 
tion by |B, |, or B,,, or | Boy |. 

Recurrence relations. Using (6.179), rewritten in the form 


co nh 
i= (et 1) y B, =e 
n=O n. 


cross-multiplying the series on the right-hand side and comparing 
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coefficients of powers of t, we find that 


ChirBat CRapBaiit «6. $ Cig Bn-ngit --- 
ooo $C7,,B, +B, = 0 (6.180) 
or, in symbolic form: 
(1+ B)rti— Brti=0, (6.181) 


where, after raising to a power in accordance with the binomial for- 

mula, all the exponents of the powers are replaced by subscripts. 
Since 

t(e'— 1)-2-—(— t)(e“*— I-12 = -t = 


25 B a 6.182 
= RY 2k+1 eq it (6.182) 


all the Bernoulli numbers with odd subscripts, n = 3, are zero. All 
the Bernoulli numbers with even subscripts are non-zero, B,,, being 
positive for n odd and negative for n even (see (6.194)). 

Laplace’s formula 


] 
sr l 0 0 
1 1 
zr sr l 0 
B, =(-—1)"!l 4 l 1 (6.183) 
, 4 31 Or ece 0 
Lo Ea 


(n+1)! nt (m—i1)! ~"° 2! 


gives an explicit expression for the value of a Bernoulli number in 
terms of its subscript. 

The Bernoulli numbers are rational. This follows, for instance, 
from the previous formula. 

STAUDT’S THEOREM. Every Bernoulli number B, can be written in the 
form 


1 
By = Cn~ Dy (6.184) 
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where C,, is an integer, and the summation is over all k > 0 such that 
k+1 is prime, k being a factor of n. 

For example, when n = 6, the factors of n are k = 1, 2, 3, 6. On 
adding unity to each of these, we get the numbers 2, 3, 4, 7, of which 
the primes are 2, 3, 7. Consequently, B= 1—(1/2)—(1/3}—(1/7) = 
= 1/42. 

Some Bernoulli numbers: 


1 I 1 
By = 1, aay B, == B= -3> 
] ] 5 
By =F» By = —3> Bio = =e 
691 7 3617 43867 
B= — 379° Bu = G> Fe = ——siq-> Bw = FOR 
_ _ 174611 _ 854513 
aot 330° ee 393° 
236364091 8553103 
2 9730.—” Boy = 6, 
ise set 23749461029 — 8615841276005 
ae 870 Roe 14322 : 
7709321041217 2577687858367 
Ba = —-——sI9 sc aaa emma 
Beg ots 26315271553053477373 
al 1919190 ; 
ae 29299939 13841559 pa __ 261082718196449122051 
al 6 2 ae 13530 


Some power expansions with coefficients expressible in terms of 
1 1 | ere 
Bernoulli numbers. Since > coth a {t/(e'-—1} ++, it follows 
from (6.179), after replacing ¢ by 2t, that 


c 2mp, yon 
t cotanh: = 1+ >) an 


. (nt ” | ¢ <= 7. (6.185) 
n= : 
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it cotanhit = tcot?t, tant = cott—2cot 21, 


t 
tcosect = tcott+itan—>, 
tanh ¢ =2 cotanh 2t—cotanh f¢, 


t 
cosecht = — cotanht — cotanh z 


we get 


tcot? = 1+ yo fan, ttl <a, (6.186) 
T= 

= oo (22n — 1)22%( — 1)n-1 at _ nm 

tan ¢ one By,t?-1, | t| x (6.187) 
oo — I2n\f —_ 1\n 
tcosect = 1+ ) eee Ba,t™, |t| <a (6.188) 
n=l : 
_v 2an(2an — 1) on—1 at 

tanh ¢ ae =. B,,t2"-1, [tl < 7° (6.189) 


tcosech ¢ = 1+ Dee es Bo nt?®-1, \t| <2. (6.190) 


Sint _ S (- V2" Bon aan 


ea eee Ith <a. (6.191) 


_ ee (— 1972723" — 1) B, pea 2 
cs ae I (On) (an nr, | tt] >? (6.192) 
oo — |] )n+1949nN(D3n—1 _ 
n—— = CE Itl<5. (6.193) 


Expressions for the sums of some numerical series in terms of 
Bernoulli numbers. If we compare expansion (6.186) with 


oo 12 oo oo 
tcotrt = 142) oa 272 = 1-2» mam 2 mn 


it follows that 
(—1)"-12(2n)! = 1 


Bon = (27)2" py man * 


(6.194) 
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The equations follow from (6.194): 
S 1 (=) Qn) 


ey me = — 2a Bae Cure) 
oo 1] (— 1)?-1(22n-1 — 1) 720 
Oa (- 1)m+2 = ea ea Boy. (6.196) 
co ] _ (— j)n—1(22n — 1)22" 
os Gm—-)* ~ dan) (Qn)! — Bon. (6.197) 
In particular, 
oe aie (6.198) 
may m 6 ; 
Bon =x? 
x 7 yet a (6.199) 
= ] 3B x? 
2, Gm) (QQm-1P? 4 °° 8° (6.200) 
oo 1 ne 
os om = 00 ° (6.201) 
co 1 IL 
pia = 945° (6.202) 
a) | 78 
pie = 450° (6.203) 


Some integrals expressible in terms of Bernoulli numbers. Integral 
forms of Bernoulli numbers. The relationship 


] ] = 
es —mtj2n~1 
mn = Ona) \-e t2n—1dt 
leads in conjunction with (6.194) to the following relationships: 
co 6yan—1 
Bon = (— 1)"-14n oma (6.204) 
12" qt 
= (— 1)r-l4n . (eta en mip * (6.205) 
men 


Bon == (—1)"-2 ) a j2n-2 In (| — e~2*t) df. (6.206) 
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Bay = (—1)"-2 GE | : — (6.207) 
B,, = (— 1)” ‘Sonn aga { ox dx. (6.208) 
Buy = (- 1 es tas (6.209) 
Boy = (—1)"-! Ee | ai dt. (6.210) 
Bon = (— ye {. (In pan fo (6.211) 
Bay = (=I ee \. an tym 7 (6.212) 
Bon = (1 —)?71 ee | "tn tan 127-1 — : (6.213) 


1 
Bons. = (— yee EDEN ED | (In 1)?” In aS. (6.214) 
0 


2°. The Bernoulli polynomials are given by the formula 
nr 
B,(x) = (x+B)"= } fe) B,x-*, (6.215) 
k=0 


A number of authors consider, in addition to the polynomials B,(x), 
the polynomials 


On(x) = B,(x)— By] (6.216) 
It follows from (6.215) that 
B,(0) = Br, Pn(0) = 9. (6.217) 


The generating function for the Bernoulli polynomials is te“(e' — 
—1)~1. Its expansion as a power series, convergent for |¢| < 2x, 


has the form 
eo nr 
feet 1)-1 = Y B(x) —. (6.218) 
n=0 nN} 


The difference equation 


fet 1 —flx) = nxt} (6.219) 
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is satisfied by the Bernoulli polynomial. This follows from (6.218) 
and the relationship 


te(x+1)i(et — 1)—1 — texte! —1)-1 = te, 
Recurrence formulae. Differentiation of (6.215) gives 
B(x) = nB,_4(x) (6.220) 
from which it follows that 


B,(x) = B,(0)-+n | *B,_3(x) ax. (6.221) 


0 


Some Bernoulli polynomials: 


B(x) = 1. (6.222) 

B(x) = xa. (6.223) 

BAx) = x®-—x + -. (6.224) 
3 ] 

B,(x) = x8 — z x? + 5% (6.225) 

B(x) = x4—2x34+x°- = , (6.226) 
5 5 ] 

B.(x) = xt Se x. (6.227) 

B,(x) = (Re? pie. (6.228) 

: 2 2 42 
B(x) = oxtail tots, (6.229) 
14 7 2 | 
ee eee Po ee ee ee ee 
B(x) = x®—4x?+ ae as 53° (6.230) 
B(x) = x®— 5x4 6x? - 384285 x: (6.231) 


By (x) = x? —5x® 4+ = x8 — 7x8 + 5x4 5 x? + = ; (6.232) 


SOME SPECIAL CONSTANTS AND FUNCTIONS 329 
Zeros of Bernoulli polynomials. The following formula holds: 
B,(1— x) = (-—1)"B,(x), (6.233) 

from which, letting x = 0, we get 
B,(1) = (—1)"B, (6.234) 


and, since B,,,, = 0, we have 


B,(1) — B, = -B,(1)— B,(0) = 0 (6.235) 
for all 7. 
It follows from (6.216) and (6.235) that 
Pn(0) = Pall) = 0. (6.236) 
It follows from (6.233) with n=2k+1 and x = > that 
1 l 
Bors =) = — Bypst (3) (6.237) 
or 
1 
Por+1 (3) = 0. (6.238) 


The polynomials »,(x) with even subscripts vanish on the segment 
(0, 1] if and only if x= 0 or x = 1; the o,(x) with odd subscripts 
vanish if and only if x = 0, x = = or x = 1. 

The polynomials 9,,(x) with even subscripts are of constant sign, 
the same as that of (—1)*, on the interval (0, 1); the polynomial 


Pon41() has the sign of (— 1)*~} on the interval (0 >). and the 
sign of (—1)* on the interval > 1 


A multiplication theorem for Bernoulli polynomials: 


—1 
B,(mx) = mr. > Bn (= + a : 


S=0 
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This relationship follows from the fact that 


co 6 B(mx)t”™ emaxty 1 emetmt(} tet+ ... +e(m-1)) _ 


= ef —] m emt] 
So nnn 
J ™=1 Aleta) m t 1 ™=1 & By (x4) mn 6.24 
“mde aT me OO 


Trigonometric expansions of Bernoulli polynomials in the interval 
(0, 1): 


B(x) = x5 = o> ale (6.241) 

B(x) = ay S08 Oe (6.242) 

a ee 
(—1)"-1 1 < sin 2mx (6.244) 


Integral forms of the Bernoulli polynomials in the interval (0, 1): 


- cos 27x — e~ 2% 
By, (x) = (- rian | cosh 2nf— cos 27x f2n—1 dy (6.245) 
0 


(sea ae ee) F 


2 sin 27x 
Bong i(xX) = (— 1)"*1(2n4+ 1) | —__—_.__—_———— f* dt (6.246) 
: cosh 27t— cos 27x 


Gr = 0). Ty 2) 4.4s)s 


Application to the summation of powers of the natural numbers. On 
assigning to x in (6.219) the values 0, 1, 2,..., p and summing, we get 


x gral = B,(p+1)— Bn 
sa} n 


or, on replacing n—1 by n, 


p = 
ys? = Fass Ua Sot (6.247) 
&=] 
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For example, 


B(p+1)—B, 1 3, p 
? ere he ae ey Seine Sie J. — |= 


Sa} 
= Pet ees) (6.248) 
= 2 
f= Blptl—- By = J (pt—2p3 +p?) _ Pp +1" (6.249) 
cS 4 4 4 
D B(p+1)—B 1 5 5 Pp 
4a OSE 8 3S Lf pS pt ps _ |) 
8 = 5(? 7 Pi +zP 4) 


= (p+ Ip + GP+3p+1). (6.250) 


a B (p+ 1)— Be == I 6_ 2,5 5 1_P ee 
Da et ag (hte = 


= Ppt Opt 27-41). (6.251) 


The Euler—Maclaurin formula establishes the connection between 
the integrals and the sums: 


| "AG ae ee eee : fe) - 
0 


= ) 
—"S Se Lymm) — fern]. (6.252) 


If f(x) and all its derivatives encountered in (6.252) tend to zero, 
while the derivatives of even order differ from zero and all have the 
same sign, the summation formula holds for m = o, if the sum and 
integral appearing in it are convergent. 

Stirling’s formula is obtained from the Euler—Maclaurin formula 
if we put /(x) = In x in the latter and make the lower limit of integra- 
tion equal to unity: 


m-1 
») Ink = mln m—m——In (m+1)+ 
= 


s is B,(m-2t1 aes 1) 


yrs Rn (6.253) 
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When n = 2, it follows from (6.253) that the asymptotic Stirling for- 
mula for the factorial] (see (6.121)) is 


m+> 
mix ./2mum 2%e-™, (6.254) 


2. Euler numbers and polynomials 
1°. The Eyler numbers E, (k= 0, 1, 2, ...) are defined as the coeffi- 
clents in the expansion as a power series of the function 


Spee, ie (6.255) 
i! RkY? 2 ; 


Since the function sech ¢ = 2/(e'+e7‘) is even, it follows from 
this that the Euler numbers with odd subscripts are zero: 
Epc Oe iS Ny De acid): (6.256) 


Recurrence relations. It follows from (6.255) that 


co f2n we yk 

1 = 2d Onl aos Ex (6.257) 

whence E, = 1 and 
Eg t+ Co,Fo+ CoE gt «2. + CBP 7B, t Eon = 0. (6.258) 

In symbolic form: 
(E+1)"4+(£-1)" =0, £E = 1. (6.259) 
Some Euler numbers: 
ER=1, b= -1l &=5, &=-— 61, £, = 1385, 


Ey = —50251, Ey, = 2702765 
Ey, = —199360981, Ey, = 19391512145, 
Exp = — 2404879675441, Egy = 370371188237525. 


All the Euler numbers are integers. This follows from the recurrence 
formulae for the E,. Two adjacent numbers with even subscripts 
have opposite signs. 

SYLVESTER’S THEOREM. If a, B, y,... are factors of the number 
n—m, the difference E,,—Ey_, is divisible by those of the numbers 
2a+1,28+1, 2y+1, ... that are prime. 
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The connection with Bernoulli numbers. Starting from the identity 


we obtain: 


oo x! 
” B,2"(2" — 1) — T= - Lae Y 
lmO * m=x0 


3 


m! 
from which it follows that 
nE— 1)" 
B, — SS e (6.260) 
Starting from the identity 
4x e 4x 
Bay) eee 
we get 
— = [ Gx x = ho 
x Bm r 2 nr nj= 2x En 
which gives 
h_ k 
ae — (4B +3)"'—G4B+ It (6.261) 


2k 


It follows from the last relationship that 


I+] 3 \2k+1 ] \2k+1 
raert 2a = (2+3) -(8+4) , (6.262) 


which gives, on taking (6.215) and (6.233) into account, 


2k +1 I 
tin Tiny (z): (6.263) 


The sign of the Euler numbers. As follows from the discussion on 
page 329, B,,,,(x) has the sign of (— 1)*~? in the interval (0, 1/2), 
so that E,, has the sign of (—1)*. 

Some power expansions with coefficients expressible in terms of 
Euler numbers. Observing that sec t = sech it, we get 


sec t = > (— 1 oes rm, |th< 5. (6.264) 
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On integrating the last series, we get 


tan (3+) |= >» (- apt 


Integration of series (6.255) gives 


in feh+1 | t]< = (6.265) 


thee Bane Dap 
arctan ef = 7 + Dy x Ee aD! 


The expressions for the sums of certain numerical series in terms of 
Euler numbers. On putting x = 1/4 in (6.244) and taking (6.263) 
into account, we get 


1 1 1 _ (= IRE, n2h+1 


(6.266) 


a 32k+1 ag Sakt+1 Jarva tc’ = 4k+1(2k)! (6.267) 
For ‘example, 
m fii 


Rae forms of Euler numbers. It follows from (6.246) and (6.263) 
that 


Eon = (— 1)"22441 | "13" sech (nt)dt (n= 0, 1, 2,...). (6.269) 
0 


2°. The Euler polynomials are given by 


1 E\" n 1] \n~-k 
E,(x) = | (= ~7*5) = py ( ; 2-RE, (= = 7) 5 (6.270) 


where E, are Euler numbers. 
The generating function for the Euler polynomials is 2e*(e' + 1)—}. 
Its expansion as a power Series, convergent for |t] < 2, is 


2e%(ef 4+ 1)-? = FEW. (6.271) 
The difference equation 


fet) 4fC) = 2x" (6.272) 


is satisfied by the Euler polynomial £,(x). This follows from the 


relationship 
Qele+Diet 4 1)~14 Zert(et4 1)-1 = 2ext, 
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Recurrence formulae. On differentiating (6.270), we get 
E(x) = nEy_3(x) 
from which it follows that 


x 
é,(x) = £,, (3) +n | E,, (x) dx. 
1/2 
Since E,(1/2) = 2~"E,, (see (6.270)), we have 


E,(x) = 2-nE yn | E,, -\(x) dx. 
1/2 


In view of the relationship 


so tT oo ym oo 
Qel=+Lt(et + 1)-2 = 2 E(x) ri 2 ol = p? E,(x + 1) at 


=Q 


we have the recurrence formula 
= [1 
E,(x+1) => (+) E,(2), 
r=Q 
or, on taking (6.272) into account, 


-E,(x) = 2x" ¥ ( F ) #9. 


r=Q 


Some Euler polynomials: 


E,(x) = 1. 
1 
E,(x) = x- >. 
E(x) = x*~x. 
E,(x) = Qa a = 
gaa San 
E,(x) = x4-—2x°4+-x. 
5 5 1 
bees eee a ee 
E.(x) = x 7 +> % x 
E,(x) = x®— 3x5 + 5x3 — 3x. 


7 35 21 17 
E(x) = x ze +x B+. 


E(x) = x8 — 4x? + 14x5 — 28x3 — 17x. 
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(6.273) 


(6.274) 


(6.275) 


t® 
! 


(6.276) 


(6.277) 


(6.278) 
(6.279) 


(6.280) 
(6.281) 


(6.282) 
(6.283) 


(6.284) 
(6.285) 


(6.286) 
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The connection between Euler and Bernoulli polynomials. Starting 
from the relationship 


te>\e2 41] = te 2%(et—1)-1—te 2(e¢—1)-}, 


we get 


ee x+1 x\} _ 
E, (x) = 1732 1Pa( : )-2, (=)}- 


= n-}2 Pate ~27B. (3) . (6.287) 


Trigonometric expansions of Euler polynomials. On using the 
trigonometric expansions of Bernoulli polynomials in the interval 
0< x < 1, we get 


Ey(x) = (— DE 42K)! ¥. [2+ I)m]-2*-2 sin (2n + I) acx 
neQ 
(n = 1, 2, 3,...). (6.288) 


Enna s(x) =(— It? (2k + tS (2m + 1)n}-24-2 cos (2n + 1) x 


(n = 0, 1, 2, 3,...). (6.289) 
A multiplication theorem: 


m-tI 
E,(mx) = m"™ yi (—1)'E, (= =) » m=2k+1. (6.290) 
To 


m-1 
E,(mx) = —2m™(n+1)-2 ¥ (-1) Bry. (= +z), m=2k. (6.291) 
r=0 
Integral forms of Euler polynomials may be obtained in the same 
way as those of Bernoulli polynomials: 


eo 727 sin 2x cosh mt 
— i Nr 
En (Xx) = (—1)"4 | oe (6.292) 
(O<x<1; n=0, 1, 2,...), 
co 72n+1 cos 2x sinh zt 
é — om n+1 ee ‘ 
Eonai(X) = (— 1414 | non 2 coe at (6.293) 


(Ove Xe ye re 0h Ty. 2... 2): 
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§ 3. Elementary piecewise linear functions and delta-shaped 
functions 


1. Piecewise linear functions 
1°. The absolute value of x (written as | x]) is: 


[o* x<0 
lx| = 0, x = 0, (6.294) 
| x, x > 0. 


lx+y| S |xl+lyl, |x—yl = Ilxl—-Iyll. (6.295) 


The binomial ware of ae a ry —— for |x| < l, is 


|x| = LY 1— x)’. (6.296) 


hae ET 


The approximation, for |x| = 1, by Bernshtein polynomials (see 
§ 1, sec. 2) of even degree is 


1. [—x?\" 2 2n l+x\F 1-—x\* 
l= gin (SE) EZ *(nne)| (is) *(7) | 


(6.297) 


The approximation by Fejer polynomials, for |x| = 2, is 
n-1l yr as 
i ae Whines, on ek Ti E 8 n—k cos (2k | 
Nl—> co n 


—>, Co 


2 2 4o42n—-1 (2k-1? |" 
(6.298) 


The expansion in Legendre polynomials P,(x) (see Chapter IV, 
§4, sec. 5), for |x| < 1, is 


Ix| = ¥ agPa(2), 
n=Q 


1 5 (2k — 3)!! 
Qong1 = 0, a, = > a, = 8° Ay, = (— 1)R+1 (4k + Dar 
(6.299) 


Fourier’s expansion, for |x| < 2, 1s 


4 = cos(2k+1)x 


7 ky Qk+TE oo 


af 
Ix] = 7- 
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The integral form is 
|x| = | oer oe Aa ons x ala Fs (6.301) 


Polygonal functions; the approximation of continuous functions by 
polygonal functions. Let Ax, y;) (i= 0, 1, 2, ..., m, ...) be given 
points. The function 


k 
tx) = Yot> [x~- Xp +] x—Xyl J+ 


+5 pi (kia —kx~x,)+|x—x;]], (6.302) 


where k, = (j441—)p/(%i4.,—%), 18 described as polygonal; its 
graph is the polygon 4)A,A, ... A,. It must be borne in mind that 
Six-@+|x—al] = 


0 for x =4@, 
x-—a for x>a. 


If f(x) is a continuous function in (a, b] , there corresponds to 
the subdivision a = xy < X,< %,< ...< x, = 05 a polygona 
function whose graph is a polygon inscribed in the graph of f(x), 
with vertices at the points (x, y,), ¥; = /(%) (6 = 0, 1, 2, ..., m). 

Every continuous function is the uniform limit of polygonal 
functions. 

On taking expansions (6.296)—(6.301) into account, we find that 
any polygonal function, defined in an arbitrary segment fa, 5], is 
the limit of a polynomial sequence, uniformly convergent in [a, 5] 
(Weierstrass’s theorem). 

Schauder’s basis. The polygonal function 


Fag(x) = Go (|x—a|~|2x—a—B|+]x-B 1), @ < B, (6.303) 


is equal to zero outside the interval (a, 8); in (a, B) its graph is an 
isosceles triangle of height 1: 
Fap(x) = 0, x <a, x > B; 
a+p 
y) ’ 
a +B 
aa 


F. g(x) = 2x—2a, x < —— (6.304) 


Fap(x) = —2x+28, x > 


SOME SPECIAL CONSTANTS AND FUNCTIONS 339 


Let y = f(x) be a continuous function in (a, 8). We introduce the 
numbers 


dd =F (2F")-FU@+IOL (6305 


Schauder’s basis is defined as the sequence of functions in [0, 1]: 
l, x, F o1(%)s F 0 i (x), F i 4) F 0 1); 
9 2 9’ 9 4 


F NX) eee a Sah) pe as 
7 ay x fer) (6.306) 


4 


(i= 0,1,..., 2-1; k=0, 1, 2,...). 


Any function f(x), continuous in the interval [0, 1], can be expanded 
(uniquely) as the series 


Fx) = 0) + YO) —-f/O)]x + 


eo Qka} 
+> ¥ di int QQ) Fa in1@). = (6.307) 
k=wQ i=0 9k’ 7p ryt “- 


The partial sum of the last series 


Sp(x) = £00) +f) —fO)] x + 
n 2 


+ >Y Vidi in) Fi iar (®) (6.308) 
24 gk’ 9 


k=O t=0 rye 


has a graph consisting of a step-function, inscribed in the curve 
y = f(x), with vertices at the points (i/2", f(i/2")) (i = 0, 1, ..., 2”). 
The derivatives of the functions of Schauder’s basis form a system of 
Haar functions (see (4.24) and (4.25)). 
2°. Sign x (signature x) is 


—1 for x <Q, 
sign x = 0 for x =0, (6.309) 


or 


(6.310) 
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or 
a” 
sign x = lim — arctan nx. (6.311) 
n— co 
Fourier’s expansion is 


ae sin (2k + 1)x 


signx=— ) 


a KX — +1” |x| <= 7. (6.312) 


The expansion in Hermitian polynomials (see Chapter IV, § 4, 
sec. 10) is 


= (Qn—2)! 2)! 2n 
aan n 
sign x = Pa 1) oaan=t oF Fons 1(X). (6.313) 
The integral form is 
2 (*T sint 


dt. (6.314) 


sien x = lim — 
To 7% |, t 


The sequence of signs of sine (Rademacher functions) is 
p,(t) = sign (sin 2kzt), (6.315) 
r,(t) = sign (sin 2kzt). (6.316) 


3°, The integral part x (written as [x], enti¢re x, E(x)). If x = n+r, 
n 1S an integer, O=r7r~< 1, then [x] =n”. 
The following relationships hold: 


[x+y] = [x] + D1); (6.317) 


| —_ B , mis an integer; (6.318) 
p+ | +5 |+ acs +|x+ | = [nx]. (6.319) 


If p and g are mutually prime integers, we have 


MEE} [Se] om 
it ]+| 3+ a +z + - ad a 


= Sy +S t+... Spt... +5,, (6.321) 


where s, 1s the number of factors of k. 
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Fourier’s expansion is 
—— (* #0, £1, £2, £3, ...), (6.322) 
1 


The function {x} = x— [x] is called the fractional part of x. It is a 
periodic function with period equal to unity. 
4°. The distance to the nearest integer [denoted by (x)] is 


(x) = min {x—[x], 1+[x]—x}. (6.323) 
The function (x) is periodic with period equal to unity. 
The Fourier expansion is 


(x) ——— y cos 21(n + 1)x 


7 One (6.324) 


5°. The jump function 1(x) (Heaviside’s unit function) is 


QO for x <Q, 
l(x) = 6.325 
1 for x =O. 


The rectangular pulse is 


O for x<a, x > B, 


l(x— p)=l(x—2) = B>a. (6.326) 


1 for «esx sf, 


If f(x) is a continuous function in [a, 5], the sequence of functions 


Als) = ¥ AMWe—a- 1-1 6327) 


tends uniformly to f(x) on indefinite subdivision of [a, b] by the 
points x;: 
AzX<X%<X<...< X= dz 


6°. The representation of certain piecewise linear functions with 
the aid of integrals and series: 


2 (~sin Ea _ | for O< x <a, 6.328 
‘I E cos fx dE= 4 for x 2a. Cz 


| ” ad(at)J(Exdt = a ee 


0 


(6.329) 
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+1] for O<x< 
22 2a. NIX 2 
— 2 5, sin =z cos —— = 
—1 for zaxx<a. 
2 n7X 
— ¥ (-1)"*1— sin — =x, O08 x5 a 
aS) a 
ZS & aia s.. Pax se 
a 1 70Nn a a 
x for Cees 
ao sit Sin — 
a nex} al 2 Qa | l 
a—x for za sxe a. 
cos as COS 
2 | 7 os a = 
; TU 6 
l for |t| = 1-6, 
2 7 =[e1) for 1-6 s|t| = 1. 
0 for |t| = 1. 
sin? — 
2|- ere ae Pes el OR ld lees 
oo 7X" 0 for |t|=1 
‘1 for Os x <a, 
4 Kern cos zx dz = = for x = 4, 
mH}, 2 2 
0 for x>a 
2 (sin ax {~. tor ae 
0 1 for a>QO 


(6.330) 


(6.331) 


(6.332) 


(6.333) 


(6.334) 


(6.335) 


(6.336) 


(6.337) 
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for x = ath, 


0 for x < a—A, 
> for x = a—h, 
. 2 fT sinht 
un a ; cos (x—a)jtdt=/ 1 for a—-h<x< ath, 
2 
0 


for x > at+A. 
(6.338) 


2. The 6 (delta)-function 


A sequence of functions {u,(x)} is said to be weakly convergent 
in the interval (a, 5) if, given any continuous function f(x), the fol- 
lowing limit exists: 


v —P co 


lim ‘ ST (x)u,(x)dx. (6.339) 


If the sequence {u, (x)} satisfies the conditions: 
I. For any M > 0, we have for |a] = M, |b|=s M: 


b 
| | u,(x) dx 


a 


<= K(M); (6.340) 


II. Given fixed a and 5, |a| > 0, 4 => 0, 


i for a<5b<0 or O0O<a <b, 


(6.341) 
1 for a<OQ <b. 


lim | " uf(x) die = 
Vp oo a 

then the limit (6.339) exists, does not depend on the choice of sequence 
{u,(x)} and is equal to f(0). The limiting element of the (weakly) 
convergent sequence {u,(x)} is referred to here as a delta function: 
6(x). Thus 


i f(x)6(x) dx = f(0). (6.342) 


Sequences Satisfying conditions I and II are described as delta- 
shaped. 
Examples of delta-shaped sequences are: 


1 


u(x) = Sere, €> 0, ue) Ox); (6.343) 
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x2 


1 _ xt 
u(x) = ea: e#, t>0, u(x) ~ d(x); (6.344) 
uOee — 2 Qhatpcs. ds, anGaGy, (61345) 


The elementary properties of the delta function are: 


6(—x) = d(x); (6.346) 
F(x) 0(x' — x) = f(x)6(x’ — x); (6.347) 
xd(x) = 0; (6.348) 
= (x — O(x —X_) 6(x ~— Xz) 

OD) = Poo ige? 6349) 

where x, are the simple roots of the equation g(x) = 0; 
5(ax) = a (6.350) 
6(x2— a2) = Kena s Wet): (6.351) 
|x]d(x?) = d(x). (6.352) 


The convergence of the series expansions and the integrals quoted 
below is understood as weak convergence. 
The Fourier expansion, |x| = 1, is: 


i(x—x') = ats ye os MATS) (6.353) 


The expansion in Bessel functions (see § 4, sec. 6), OS rs R, Is: 


n(z) (©) 
5(r’— en eT HG (6.354) 


Jm(Sn) 


The expansion in Legendre polynomials, |x| = 1, is: 


d(x’—x) = y 


p> 


zt + | D (x')P,(x). (6.355) 
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The expansion in Hermite polynomials is: 


x2x’3 


5(x’ — x) > ae : 2H (x’)Hy (2). (6.356) 
Integral forms. Fourier’s integral is: 
0(x’—x) = — | ~ cos k(x’ — x) dk. (6.357) 


The Fourier—Bessel integral is: 


Cn | ” Iglkr)Jny(Ker’) dk 


= (6.358) 
d(r’) = r’ | kJ y(kr’) dk. 
0 
The involution is: 
- Bt — pn)O(t— pg)dt = 8( 0 — py). (6.359) 
The derivatives of the delta function are given by: 
d(x) = 1'(x); (6.360) 
| ” f(x)8'(x—h) dx = —f'(h); (6.361) 
- ST (x)6 (x ~ A)dx = (— 1 f(A). (6.362) 


Series of delta functions are: 


COS X+COS 2x+...+cCOSmMx+...= 
= -stn x S(x—2nn); (6.363) 
sin x+2 sin 2x+ ... +nsinnax+...= 
= —¥ 8(x—2an); (6.364) 
cosx +4cos2x+...+n* cosmx+...= 
= —2¥3 8"(x—2nn). (6.365) 
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§ 4. Elementary special functions 


1. Elliptic integrals 
DEFINITION. Any integral of the form 


= R(x) 


o ¥ P(x) 


where R (x) is a rational function of x, and P(x) is a polynomial of 

the third or fourth degree, can be transformed to a sum of integrals, 

reducible to elementary functions, and to integrals known as elliptic 

integrals in Legendre’s normal form. The latter include the following: 
the elliptic integral of the first kind, 


dx, 


ne dx 
F(k, 9) = [. ————==——= ————} (6.366) 
0 (1 — x?)(1 — k?x?) 
the elliptic integral of the second kind, 
sin 9 JI k2x2 


E(k, p) = | dx; (6.367) 


0 /1—x* 
the elliptic integral of the third kind, 


sin » dx 
vit A, = ——ee— 6.368 
ae [. (+ Ax?)./ (1 -- x*)(1 — k®x?) ( ) 


The notations: F(y, k), E(py, k) and I1(g, A, k) are sometimes 
employed. 

The parameter k is called the modulus of the integral, and A the 
parameter of the integral of the third kind, k? < 1. 

The number k’ = 1—k? is called the complementary modulus. 

The quantity « is often employed, instead of k, where k = sin a. 

If we put x = siny, the elliptic integrals reduce to the normal 
trigonometric form: 


? dy ? dy 
Fik, — SS “~*~ > 6.369 
om i J1—K? sin? p I. Ay on 
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? ? 
E(k, 9) = {’ J1—k* sin? yp dy = (' Avy dy, (6.370) 


Ik, 24, 9) = 


 .; ns hc 
{’ (1 +A sin? y) /1—k?* sin? p . { (i+Asin? p)4y’ 
(6.371) 
where 4p = V1—k? sin? y. 


The following notation is used for a commonly encountered 
combination of these integrals: 


Fi(k, 9) -E (k, ? sin® 
Dik, 9) = EE aL a 


o 4p 
\ ° x* dx 


 Wosaqren 63”) 


Representations as series: 


1 1.3 1.3.5 
F(k, ~) = Agt > Aik? +57 74 A,k* +$———- 54.6 A,k® + wees (6.373) 
] 1 1.3 
Elk, 9) = do~ a AiO 7 Ak — Se Ask — 
1.3.5 : 
946.8 A,k em eo eo 9 (6.374) 


where 
? 
A, = | sint"xda (n= 0, 1, 2,...). (6.375) 
0 
The coefficients A, can be evaluated successively in accordance 
with the formulae: 


yr ay ee ay 


In An-1 s COS P sin2"—1 gy, (6.376) 


If @ is close to 2/2, the following formulae are convenient: 


Fk, 9) = F(k z)-F (k, 9). (6.377) 
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E(k, 9) = E(k, 3) —E(k, 9) + k* singsing,, (6.378) 


gy, being given by the equation 
COS © 


JI—k? sin? p 


If the upper limit of the integrals is equal to z/2 (p = 2/2), the 
complete elliptic integrals are obtained. 
The complete elliptic integral of the first kind is 


_ Ed _ /2 ap 
K = F(k, ) = [5 = | ES =e ae: (6.380) 


The complete elliptic integral of the second kind is 


sing, = (6.379) 


E=E (« 3) | ™ dedg = | == se aa dx. (6.381) 
Here, 
D=D (« 3) = = (6.382) 
Representations as series and products: 
K = = } +> ar | at (6.383) 
pe Fie Ecole] sts om 
D= ny — hee bee (6.385) 


1 1—/1—k2_, 
= — J] (1+k,); where k, = ee ele k, = k. 

2 a . baa/ Take n—-1 : 
(6.386) 
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Fic. 5. Elliptic 
integral of the first 
kind = Fk, 9); 
k=sina=const. OO 


ERE 
eee (es a 
Pog tt 


ase 
7 Aon ease 
0 10 20 30 40 50 60 70 80 90° 


——w 


0 10 20 380 40 50 60 70 80 30° 


—_— 


Fic. 6. Elliptic 
integral of the se- 
cond kind E(k, 9); 
k=sin « =const. 
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ed a a A 
E=aeee 7 


cece eee 
“0 10 20 30 40 50 60 70 80 390° 


——me (Y 


Fic. 7. Elliptic integral of the first kind F(k, ¢); p = const, X=sin a. 


is fe 
eC 
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GO 


Fic. 8. Elliptic integral of the second kind E(k, vy); gy =const., k=sin a. 


SOME SPECIAL CONSTANTS AND FUNCTIONS 351 


The following formulae are employed when k is close to 1: 


K=m+(5 pte (eat -1-gy) Rt 


135" 2. ON 
3 
12,324 2 oO PN 
+7846 ("-Ty-3a-3) k +. ee (6.388) 


Here, m = In 4/k’. 
Some integrals are: 


K dk 1 eD—K 
Edk  k* K-2E 
| Kk dk = E-k°K = k*(K-D); (6.391) 
| dk = Lik? -< kK (6.392) 


Graphs of the elliptic integrals are shown in Fig. 5, 6, 7 and 8. 


2. Integral functions 


DEFINITION. The following definite integrals are known as integral 
functions: 
The integral exponential function 


. x et 
E1(x) = | 7 at (x < 0). (6.393) 
The integral logarithm 


li(x) = ape 


Int (0 < x < 1). (6.394) 
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The integral sine 


si(x) = a at (sic => 


x 


The integral cosine 


d)== — dt (x < 0). 


In addition, the following notations are used: 


Six) = 24 0) =( Te atl Sie) = 5], 
(x 7 + six 1( 5 


f 
Ci (x) = ci (x). 


When x > 1, the function li(x) is defined as 


im { ("14h (* at 
e+>o| |, Int +e Wnt | 


(6.395) 


(6.396) 


(6.397) 


(6.398) 


When x > 0, the function Ei(x) takes complex values; the real 


part of Ei(x) is denoted by Ei(x). The bar above the Ei is occasionally 


omitted. 
Relationships between the integral functions are 


Fi(inx) =li(x) (x <1); 
Ei(nx)=li(x) («> 1); 
li (e*) = Ei (x) (x < 0); 
Ei (ix) = ci (x)+isi (x); 

Ei (x + i0) = Ei(x) F zi; 
Si(—x) = —Si(x); 
si(—x)= —Ssi(x) —7; 


Ci(-x)=Ci) tm = (x>0); 


ine x ? 2 
Si (2x) = sin? x +/ cw dt. 
x 0 t 


(6.399) 
(6.400) 
(6.401) 
(6.402) 
(6.403) 
(6.404) 
(6.405) 
(6.406) 


(6.407) 
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Representations as series are: 


Ei (x) = C+In(- x)+ Ser — (x < 0); 
— co xk 
Bi (x) = C+inx+ ) EET (x > 0); 
li (x) = C+In(—In x)+ 7 a (0< x < 1); 
li (x) = C+Inln x+- z Ezeh (x > 1); 
fn ier ])k+1 SS 
Ae TESTE 
i(@) = C+iney 5 (—1 
ci (x) = tinx+ ) (~ ) 2k(2k)! 


Here, C = 0:57721 56649... 
Approximate formulae (for small values of x) are: 


Si (x) + x 
si (x) = x—-; 
Ci (x) = Ei(x) = 


Ei (—x) ~ C+ln~x. 


Asymptotic formulae (for large values of x) are: 


= e I! 2! 3! 
Ei (x) = <(2 Tog hog th aay re ); 


x. 2 x 


am 3! 5! ) cos x 
ere a tag es) a 
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(6.408) 


(6.409) 


(6.410) 


(6.411) 


(6.412) 


(6.413) 


is Euler’s constant (see p. 310). 


(6.414) 
(6.415) 
(6.416) 


(6.417) 


(6.418) 
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i ! ! 
ci (x) = == (: aS. )- 


cos x € 3! 5! 


x xe 


Some numerical values are: 


Fi(—1) = —0-21938 3934... . 


Ei (1) = 1-89511 7816... . 
li (1-45136 92346...) = 0. 


Some limits are: 


lim si(x) = —2; 
x—> co 

lim ci (x) = + 21; 
x—> 


lim [x€si(x]=0 (e < 1); 


X—> + 


lim [x¢ci(xX]} =0 (0< 1; 


xX ~> + oo 
lim e-* Ei(x) = 0; 
x—> + ce 
lim xe™* Ei (x) = 1. 
x—> + co 


Some integrals are: 


i (—mt) dt = x Ei(—mx)- 


0 


0 


———+--... 


]—e—™ 


- e~P! Ci (gt) dt = -<in € +> 


(6.420) 


(6.421) 


(6.422) 


(6.423) 


(6.424) 
(6.425) 


(6.426) 
(6.427) 
(6.428) 


(6.429) 


(6.430) 


(6.431) 


(6.432) 


(6.433) 
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Fic. 9. Integral functions: the sine Si(x), cosine Ci(x), logarithm li (x) and expo- 


nential functions Ei(—x) and Ei(x). 
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Fic. 10. The integral exponential function Ei(x) and the integral logarithm li(x). 
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Fic. 11. The integral exponential function —Ei(x). 


| ~ e~P' si (gt) dt = ae arc tan £. (6.434) 
0 q q 


- cos t Ci (t) df= | ” sin t si(t) dt = -+; (6.435) 
0 0 


| ” ci2 (1) dt = | “sit() dt = 2; (6.436) 
0 0 , 2 
| ” Ci(t) si(t) dt = —In2; (6.437) 
0 
- x — for « > B, 
| ci (at) ci (Bt) dt = | si (xt) si(Bt) dt = 1 (6,438) 
0 0 


4 
3B for « < B. 
The graphs of the integral functions are shown in Fig. 9, 10 and 11. 
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3. The error function 


DEFINITION. Zhe error function is defined as the function 
efx = rai e- dt — [erf(~) = 1] (6.439) 
Va J 0 


It is often defined as 


P(x) = 2 Pars dt (6.440) 
% Jo 


or (by S.N. Bernshtein) as 


x 
®,(x) = a | e @dt= + Bx) - zet(+). (6.441) 
0 


The following notations are also encountered: 


2 oo 
erfex = l-erfx = —=| e-" dt, (6.442) 

Rl) 
L(x) = | e~? dt = . erfc x. (6.443) 

x 
Relationships between the functions erf x and (x) are: 

@(x) = erf ( : (6.444 
@) = at( 5) iia 
erf x = D(x ./2). (6.445) 


The derivatives of the error function are: 


d De nies 
ae (erf x) = a aaa alt (6.446) 

d [2 -= 
zz PO) = =e 2, (6.447) 


The integral of the error function is: 


erfx dx = xerfx ee e~F C, (6.448) 
aa 
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Other integral forms are: 


x? p-t 


erfx = —=| —=—df; (6.449 

ree 

erf (xy) = ze en ¥242 a: (6.450) 
e- va 

erf (./qx) = jt (= Ta (6.451) 


el 
COeen nena reer eee 
TCA er LO 
ow Piet ere OO 
40's 7 eer 


QS LO LS 20 L9 3.0 


——_—ge X 
x 
Fic. 12. The error function erf x = (2)/x )| e—? dt. 
0 


The representation as a series is 


> = x2k~1 2 oo §=DRy2k+1 
erf ec Pe 1 Se ee Sy 
Te ne | ) (2k —1)(kK—1)! Jn Keo (2k + 1)!! 
(6.452) 


Asymptotic formulae are: 


i 
r(k+= 
erf (./x) = a y (— 1)* r(k+3) Pais R,, (6.453) 
1 k=O h+= 7 


x 
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] 
r(n+7] 
Ee 


1 9 
n+— 
|x| 2 cos “7 


where 


x = xelP and g*<27?; (6.454) 


erfc x ~ 


ae Il 1.3 1.3.5 
= | — 2 te ee a |. (6.455) 


The graph of the function erf x is shown is Fig. 12, which also 
gives the graphs of tanh x and 1— e* for comparison. 
4. Fresnel integrals 


DEFINITION. The following functions are called Fresnel integrals: 
the Fresnel sine integral, 


S(x) = ‘Ah sin t? dt | sc+ oo) = +} (6.456) 


the Fresnel cosine integral, 


C(x) = ‘A cos ft? dt ct +o) = | : (6.457) 


The following definitions of the Fresnel integrals are also 
occasionally encountered: 


x 
S*(x) =| snd = s{ /—*), (6.458) 
Pa) 2 
x 
C(x) -| cos = iat = c( Ax), (6.459) 
0 


Other integral forms are: 


1 (** sint 
S(x) = — dt; (6.460) 
Vamfo Vt 
2 
6S Sw (6.461) 
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= _2y me 2) Je. 
S(xy) = ak sin (y*t?) dt; (6.462) 
C(xy) = e oor (y*1?) dt. (6.463 
) 


The representations as series are: 


xth+3 
sae ‘> 2, a ™ | ee) 


C(x) = 22 Ge ete (6.465) 


The asymptotic formulae are: 


1 1 : 

S(x) = > Jax cos x*+0 (=) (x ag oo) 5 (6.466) 
sae 
2 


] ; ] 
ae sin x?+0O (=) (x +o). (6.467) 
The connections between the Fresnel integrals, Bessel functions 
and the error function are: 


ees |. "7 = (t) dt: (6.468) 


C(x) = z| 73 z (t) dt; (6.469) 


C(z) + iS(z) = 3 erf (= +;)= /2 { et! dt; (6.470) 


C(z) — iS(z) = Ti erf (z./i) = ‘I e-ittg;, (6.471) 


Some limits are: 


lim SQ) = lim C(x) = 5; (6.472) 
x—> + co 


X—> + co 


lim 1x*| Se — |} = lim }*[c-> |} =Q (o< 1). 
x—> + co x—> + co 


(6.473) 
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Fic. 13. The Fresnel integrals S(x) and C(x), x?=z, 


Some integrals are: 


| S(ax) dx = pS(ap) + a a (6.474) 
| " Clax) dx = pCtap)— —— (6.475) 

a4 | 2./2 cos = sin a 
{. [77 50) | sin 2px dx = so F (p > 0); 
(6.476) 

ons | 2/2 sin = sin a 
{. |Z C19 | sin 2px dx = — = P (p > 0). 
(6.477) 


The graphs of the Fresnel integrals are shown in Fig. 13. 
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5. Gamma and beta functions of Euler 


The so-called Euler B- and I’-functions are important non-elementary 
functions. They are defined by improper integrals dependent on a 
parameter; they have been carefully studied, and fairly detailed tables 
have been compiled for them. 

The fundamental properties of the functions are described below. 
All the parameters appearing in the formulae are real. The operations 
employed, of differentiation, integration, change of the order of 
integrations, summation, etc., are valid, inasmuch as the integrals 
are absolutely and uniformly convergent for the values of the 
parameters considered. 

1°. Definitions, functional equations and elementary properties 
of the I (gamma)-function of Euler. For « > 0, Euler’s gamma 
function is defined by the integral 


T(@) = | ~ yates dx, (6.478) 

Change of the variables leads 7" the formulae: 
T(@) = [ (15 =)" dx; (6.479) 
Tle) =| et*e~e dx. (6.480) 


Integration by parts of .(6.478) gives 
Ia) = («-1) P(a—-1) (6.481) 

and in general, for integral n and a > 0, we have 
Ia) = (a—1)(«@—2)...€a—n+1)[(a—n+1). (6.482) 

On putting « = n (integer ) in (6.482), we get 
I(n) = (n—-1)! (6.483) 
Continuation of the gamma function into the negative semi-axis 
is accomplished in accordance with the formula 

I(a) 


a—l 


T@-1) = (6.484) 


I) = cat) (6.485) 
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first into the interval (—1, 0), then into (—2, —1), so that, for —n< 
<x< —(n—1), 


= I(x +n) 
PX) = x(x +1)...(x+n—1)’ or 
whence, for 0 < a < l, 
T(a—n) = (—1) ie) (6.487) 


(l—a)(2—a)...(m—a) © 


The function J(x+1) is often denoted by the symbol J/(x). 
The gamma function is discontinuous for all integral negative 
values of the argument, since it follows from (6.485) that 


lim |x7~W(x+1)] = ©. (6.488) 
x——-7n 
x>-n7n 


It follows from (6.478) that, at points where the gamma function 
is continuous, its derivatives may be evaluated from the formulae 


I"(a) = \- xt-le-* In x dx, 
(6.489) 
Lg) = | x*—le-= (In x)*dx. 


0 


REMARK. An equation of the form 
F(x, y(x), y'(x), «.. y™(x)) = 0 


where F is a polynomial in its arguments x, y(x), y’(x), ..., y(x), is 
called an algebraic differential equation of the nth order. A function 
y(x) is described as hypertranscendental if it is not a solution of any 
algebraic differential equation with polynomial coefficients. The 
function /(x) is hypertranscendental. 

For instance, y(x) = sin x is a solution of the algebraic equation 
y *+y* = 1, so that it is not a hypertrascendental function. 

An elementary asymptotic formula. It follows from the inequality 
with 0 < « < 1) 


n*I'(n)—e~Mnttn-l ~< [(a+n) = 


n co 
= | +| < nt-1f\(n+1)+e7™n%+"2-1 ~— (6.490) 
0 


n 
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that 


DED 2 (6.491) 


Jum nina-1 

The representation of the gamma function as a Series is mentioned 
in Chapter III, § 3. sec. 16. 

Expressions for I(x) and I-*(a) as infinite products. If we use 

(6.491) and replace J'(x+n) in accordance with (6.482), we arrive 


at the Euler—Gauss formula 


Be: dood n! 
Oe Hat. wan ON 
or 
P(«) = lim n* — (6.493) 
n-—> co TI (~ +) 
»=0 


We can obtain from these last formulae, on making use of the 
transformation 


nr 
—a In n+ >, — n a 
=e val |] ((1 +2 )e : ) 


the Weierstrass formula 
l = a\ -— 
_- — P-lly\ — ea oe » (6.494) 
Tia) I(x) = e eI ((1 +i)e ), 


where C is the Euler—Mascheroni constant (6.56). 
The formula for the complement 


I(®r(—2«) = (6.495) 


SiN 70% 


follows from (6.493) and the formula 


SID 7% : us a 


SOME SPECIAL CONSTANTS AND FUNCTIONS 365 


In particular, it follows from (6.495) that 


1 
r(4) Se (6.496) 


Since we have, from the formula for the complement, 


] 2 n—1 2 7n—1. 
Ir(a)r(a)r--( i )] a a) _n-l ’ 
sin —~ sin —~... sin a4 
n 1 n 


(6.497) 


we obtain, in view of the relationship 


"| .. kn n 

SIn—— = 5n-=1 
at ; qn=1 
the Euler product: 


=—1 


l 2 n—1\ _ (2z) ? 
r(2)r(2)..-r(452)- 22 ow 


The multiplication formula 


ja v eet —kea es 
[| r (« +4) =: (21) 2k 2 T(kx), >0, k is an integer=1, 
= (6.499) 


follows from (6.493). When k = 2, we get the (Legendre) doubling 
formula 


Per (« +4) _ S27 ra), (6.500) 


The logarithm of the gamma function. On taking logarithms of (6.493) 
and passing to the integrals, we arrive at the integral form of the 
logarithm of the gamma function: 


= n n 


oo 0 enx e(n+a)x ens — e(n+1)x 
— ——_— OO —- - 1. -—CCCOOOO9hS S a —— 
nal . x x 
0 61—e%—a(l —e*) 
= Ce 
| xe) as 


in Ia) = { er ~@—ne |S, (6.501) 
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Other integral forms are: 


In I(a) = [- | @— Det | £, a>Q, (6.502) 


t— 


a dt 
inne = || 4 fet Dae > 0. (6.503 
F ra fint i (6.503) 


Raabe’s formula. On taking logarithms of the Euler product 
(6.498), we get 


z k\ 1 1 1 ] 
der (sa = aos) In 27 — >, 2 n, 


and if 


we have 
1 
| In (a) dx = In ,/2n. (6.504) 
0 


The Raabe integral is obtained by differentiation with respect 
to the parameter: 


Fm | in Tats) de = 2 (ne—1+ /2n). (6.505) 
0 


Another expression for the Raabe integral is obtained by inte- 
gration of (6.501): 


0 6daxT e% e 1 
It follows from (6.501), (6.506) that 


In I'(@)~-J+ me = | , f(xye* dx, (6.507) 


where 
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On introducing the Binet function 
0 
w(a) = | S(x)e% dx, (6.508) 


we get an asymptotic expression for the logarithm of the gamma- 
function: 


In I'(«) = In /2a+ (< -+) Inz—a+o(a). (6.509) 


It also follows from (6.501) and (6.506) that 


J—-inl (« +5) = [ F(x)e%* dx, (6.510) 


where 


roy = (4-4), 


From this we obtain an asymptotic formula for J’ («+3)} 


inl (« +4) = «(Ina—1) + In /27—a,(a), (6.511) 


where 


w(«) = {’ F(x)e™™ dx. (6.512) 


The following relationship holds: 
W,(«) = w(a)— w(2«); (6.513) 


it is obtained by taking logarithms of the doubling formula (6.500) 
and substituting for In J(«) and In J(2«) in accordance with (6.509) 


and for In I’ («+5) in accordance with (6.511). 
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The following formulae are due to Schaar: 


e ‘ m2 = 2et* dx 
io i llc S| ae : 
1 (-*° adx 
=+ | eo In(l—e?™*), (6,514) 
a dx 1 (~* 2a dx 
= — — p2ex)\ i —. bg eevee — e2%x) — 
Ww (a) 3% eae ———; In (1 — e?**) . {. Iota xt In (1 — e2**) 
0 adx 
= zl. Bast In (1 + e2"*), (6.515) 


The Stirling and Gauss asymptotic formulae. By using (6.179) and 
(6.508), we can obtain the Stirling series for the Binet function: 


_ B 1, B; | 
WO) = Zt 3.4 Py a tein 
Bon—2 l 
+ Gn DGnaa amas tR (6.916) 

where 

R= 6 Ban I pees ee 

7 (2n—1)2n «27-1 ? . : 
When 7 = 1 
__ 22 _ 9 
o(x%) = = = 5 


and Stirling’s formula follows from (6.509): 
inne Va+(« -})ina-a+ih, (6.518) 


Be ages 
D(a) = tna te °* Be, (6.519) 


Stirling’s formula is again obtained when « is equal to an integer m: 


m @ 
m —— 
ae, — } elem | 6.520) 
m! zm) e ( 
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An asymptotic formula for @,(~) follows from (6.513) and (6.516): 
_ B L\ 1 2B, 1\ 1 
a) =: vat -z)atae() od ae 


Pee ] 1 
+E ( 3) e+ we (6.521) 


In particular, 


sa Be. 1\1_ 6 


Gauss’s formula follows from (6.522): 


] — 6 
In r(« +4) = «(Inzx«—1)+ ln J2n— 5. (6.523) 


I ; 
When n is an integer and a = n+s, a formula is obtained fora 


factorial that gives a better approximation than Stirling’s formula: 


L ane 
n+ 2 


y) eee 
e 24n+12 , (6.524) 


na VE 


The power expansion of the logarithm of a ganna function. It 
follows from (6.481) and (6.493) that 


log [(1+a)= 


_ (% de I'(a) e oy a | ] = 
PSA f[-e8( a 


€ 


= Cap at-Batptat..., (6.525) 
where 
] | 
Sp l+—a5 + P arr na 
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The trigonometric expansion of the logarithm of the gamma 
function (Kummer’s series). If, when x€ (0, 1), 
In I'(«) = ~ + ¥ (a, cos 2nna +b, sin 2nzx), (6.526) 
n=) 
where 


1 
a. = 2 | In I’ (x) cos 2mmx dx (n= 0, 1, 2, ...), 


0 


(6.527) 
b, = 2 | are) sin 2mmx dx (n= 1, 2, 3, ...), 
0 
we have by the formula for the complement: 
In F(a) + In P(1—a) = ay + ¥ 2a, cos 2nna = 
nel 
= In2x— Insinzx = In2x+ Y ae, (6.528) 
nel 


whence 


5 % =In/2nx, a, = = (n= 1, 2,...). (6.529) 


We have from (6.502) and (6.64): 


—_ 
DS 2 ———- x +1 ) sin 27x dx = 
ca, —t 
es —.  — e-~2anku a_i } —e7u au 
na | — u nn | 1+ u 


| is “UW p-—antu du = i 
3) (e e ) oe (C+1n2nz). (6.530) 
Further expansions of the logarithm of the gamma function are 


In (1 +2) = 525 —Ca-So—-bab—..., (6.531) 


mad +a) = sae l-—«@ 


a as 
+(1—C)x—(s3— 1) aa (s;—1) Soe (6.532) 
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The logarithmic derivatives of the gamma function (the psi or 


digamma function). By definition, 


v2) = FS = Fe); 
_P@+)_ da 


so that 
] 
P(a) = pa) +—. 
The function »(«) satisfies the functional equations: 
1 
y(1 +2)— fa) = —. 


y(a)—p(l—x) = —2 tana. 


y(a)—p(—a) = ~ntanna——. 
pl +%)--p(il—-«) = — mtan ma +—. 
z a Be = mtanz 
y 5} + y 5 x\|= a. 
m-1 r 
y(ma) = m-1¥)° v(« +E )+ In m. 
rmQ m 
It follows from (6.492) that 


I"(«) l ale Aa | l 
P= Te), ae RCs ): 


or, in view of the fact that 


we have 


(6.533) 


(6.534) 


(6.535) 
(6.536) 


(6.537) 


(6.538) 


(6.539) 


(6.540) 


(6.541) 
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It follows from (6.541) that 


we) = ~6+ 5 (rar [ wresa) = 
= 0 0 


]—fe-1 
ie SO { —— dt. (6.542) 
=, 


On carrying out the change of variable 1+ y = t7~1, and taking 
account of (6.63), Cauchy’s formula is obtained: 


= ] d 
(a) = | jer" a > a >Q, (6.543) 
0 


Other integral forms are: 


ad e7~t— e~la 
(x) = -c+| at, > 0; (6.54) 
0 
‘eo en~t eta 
(a) = { (-7) dt, a> Q; (6.545) 
0 
] = t dt 
ya) = Ina—=-—2 [ (+ a2\(ee— Ty ’ (6.546) 
1/1 pent 
0 


(a) = | “a+ 4-9 2-6 a>0. (6.548) 
0 


Some particular values of the gamma function and its derivatives 
are: 


Tq) = FQ) =1; (6.549) 

I(0-5) = ./n; (6.550) 

I'(—0°5) = —2./x; (6.551) 

I (: $4) = =i (2n—1)!!; (6.552) 
— n 2” fac 

r(4- "| = (—]1) aI (6.553) 

yd) = — C; (6.554) 
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(6.555) 


(6.556) 


(6.557) 


(6.558) 


(6.559) 


The-graphs of I(x), (x), 1/I'(x) and 1/H(x) are shown in Fig. 14 


and 15. 


—f. 25 oa ae oe 


x 


Fic. 14. The gamma functions I(x) and I'(x+1) = M(x). 
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Fic. 15. The functions 1/I(x) and 1/I(x). 


Properties uniquely defining the gamma function. A function F(x), 
continuous along with its derivative for x >0, is a gamma function 
I(x) if it satisfies any one of the groups of conditions enumerated 


below: 
I. (a) F(x+1) = or 
(b) F(x)F(1—x) = 


sin 2x’ 


(c) F(x)F € +4)- ao F(2x). 


II. (a) F(x+1) = xFO), 
(b) FoF (x +4) = aoe F(2x), 


2 
(c) F(x) #0 for x>0. 


III. (a) F(1) = 1, 
(b) F(x+1) = xF(x), 
(c) F(x) is a logarithmically convex function for x > 0 (see 
Chapter I, § 3, sec. 17). 


IV. (a) F(l) = 1, 
(b) F(x+1) = xF(x), 
(c) (e/x)*F(x) is decreasing for x > 0 (orx > M). 
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2°. Definitions, functional equations and elementary properties of the 
B (beta)-function of Euler. Euler’s beta function is defined by the 
integral 


Ba, P= [ sd-e dx, a>Q0, B>0O. (6.560) 
0 


Integration by parts leads to the functional relationships 


Be, 8) = ay Bw, B-1), B>1, (6.561) 


a—] 
B (a, B) = a+p—1 Ba l, B), a> 1. (6.562) 
The B-function is symmetrical: 
B (a, B) = B(B, a). (6.563) 


The connection between the binomial coefficients and their general- 
ization. Since, when m and n are positive integers, 


(n— 1)!(m—1)! 
(m+n—1)! 


] _ {mt+n-1\ | 
nB(m,n) \ m-—-1 ?’ 


B(m, n) = (6.564) 


we have 


(6.565) 
l _ {m+n-]1 
mB (m, n) =( n— 1 ) 
whence, when a2>0, 8>0, 
a+b—1 1 
( ae )- em (6.566) 
a+B—-1\ _ ] 
( B-1 )- BB (a, B)’ coe 


An expression in terms of the gamma function. On replacing x in 
(6.560) by y/(1+ y), we arrive at the formula 


y2-ldy 


ag, (6.568) 
> (+yerF 


B (a, B) = 
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whence 
a . (7 L@+By*-t dy _ 
B(«, B)E(«+B) = \. ~ (+yeth = 
= {[ e- x+y) x7 +B-1 yo-1 dy dy = 
oJ0 
= | 7 e-XxB-1 dx : e—*U(xy)*—-1d(xy), (6.569) 
0 0 
and finally, 
P(x) I(B) 
Bia, p) = =>. 6.570 
(% B= Term (6.570) 
Other integral forms are: 
1/2 
B (a, B) = 2| sin2@—1m cos*F-lgdp; (6.571) 
0 
7/2 
B(a, B) = 2 | sin2"@ cos*Fodp, te , p>—-—~; (6.572) 
0 


a 2a—-1 
B(z, 8) =  aeeeely —— (6.573) 


a>0, B>0; 
1 po-1 4. {h+1 
B(«,p)= | —— dt, «>0, B>0; (6.574) 
0 (1+t) op 
I 1(1—t)?-1 dt 
B (a, a) = en | ———— (6.575) 
ce 


Representations as a series and infinite product: 


B (a, B =5 5 ¢ (yp B>0; (6.576) 
= k(@+B+k) 


B (a, B) = i GHGs h. (6.577) 
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6. Bessel functions 


The Bessel functions of the first kind J,(x) are defined as the 
coefficients of the power expansion in the variable t of the generating 


Med. 


Ore - = e2 4 2 : = 


function 


= ¥ s(x (6.578) 


oo — 1] )8xn+2s 
JA(x) ee ee —co < X¥ <-++oo, (6.579) 
J_(x) = (—1)"J, (x). (6.580 


The Bessel functions of an imaginary argument J/,(x) are defined 
from the relationship 


eee = 

er TFL FS TCO; (6.581) 

I bend xnt29 

n(X) = oe W+2(y + s)tsl’ (6.582) 
I,(x) = in” J,(ix), (6.583) 


1_,(x) = i"J_,(ix) = i"(—1)"J,(ix) = i-"J,(ix) = I(x). (6.584) 


The trigonometric forms of the generating functions. It follows 
from (6.578) with ¢ = e’? that 


eixsin ep = J,(x)+2iJ,(x) sing + 
+ 2J,(x) cos 2¢ + 2iJ,(x) sin 29 + 2J,(x) cos4p+..., (6.585) 


whence 


cos (x sin p) = Jo(x) +2 ¥ Jng(x) cos 2kg, (6.586) 
kal 


sin (x sing) = 2 3° Jonaa(x) sin (2k + De, (6.587) 
k=0 
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and similarly, 
elses = J(x)+2 ¥ #J,(x) cos sp, (6.588) 
s=]} 
cos (x cos pg) = J,(x)+2 & (— 1)*J.,(x) cos 2k, (6.589) 
=1 


sin (x cos y) = 2 2 (—1)¥Jon43(x) cos(2k+1)p. (6.590) 


Bessel’s integral. On regarding (6.586), (6.587), (6.589), (6.590) as 
Fourier expansions, we get 


« aJ,(x) for n= 2k, n=0 
cos ny cos (x sin gy) dp = i ; ” (6.591 
{. aed ee 0 for n= 2k+1. ( ) 
mene. Oe Ree eae) 
0 aJ,(x) for n= 2k+1. 


It follows from these formulae that 
I<x) = - | cos (np — x sin p) dp (Bessel) (6.593) 
0 


where 7 1s zero or a positive integer. 
Addition theorem. Since 


1 = 1 és 1 = 
= (ute) (tt—}) = aa ae a 


y Jn(ut+v)t" = e 


= py _ Sela? om I(oyt", 
we have 
J,(u+v) = b> _ TDIn—s) (6.594) 
or 


J,(u+o) = . Ist) Ina) + 


+3 (-D{ADns) + InvDI)}- (6.595) 
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Similarly, 


Int +0) = Ye LDn-a(®) = Ys Lins) + 


7 > {Ie(u)In4 0?) + Ins a(uig(v)}. (6.596) 


Fic. 16. 


The addition theorem in Neumann’s form. It follows from Fig. 16 
that 


R = Jr? + o%—2re cos y, 
Rcos (y+) = tcose+ocosf = rcosx+ocos(t—-y+2)= 


= rcosa+ocos(a—y), 
whence 


» i"J,(RyerPreint — > imJ_(r)eime d. (— 1) (oe vet* — 
= Lire Y (-NQrade™, (6.597) 
and 
Jn(Rere = Ye (-NV)Inae™, (6.598) 
Jn(R) cos mp = (— VL (QIn-i) cos tp, (6.599) 


J,(R) sin np = ¥ (—1)'*25,(0) Jn_i(r) sin lp. (6.600) 
i 
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When 7 = 0, 
JAR) = Jol R)Jo(0)Ai(7) cos lp (6.601) 


_ i 
When r = 0, R = 20 sin> y =z sin 6, 


J,(z sin #) = J? @ +2 > J? (5) cos 2/6. (6.602) 
=1 


Bessel’s differential equation, which is satisfied by the Bessel 
functions J,,(x), is 


x* a +X 2 + (x?—n*)y = 0. (6.603) 


Correspondingly, the J,(x) satisfy the equation 


wt 


rae +x # (x?+n)y = 0. (6.604) 


Recurrence relations are: 


Inax(X) = = In(x)— Inf): (6.605) 
Inni(&) = In x) + In); (6.606) 
TQ) = 5 ns) Ine (6.607) 
Inai() + Ina) = In); (6.608) 


d d 
Fx n) = x Sn His Fy Mn) = — x7" n+1° (6.609) 


The Bessel functions of the first kind J,(x), ” not an integer, 


(—1)§ xX \N+2s8 
we) = 3 rezyracscy (7) _— 


satisfy the differential equation (6.603). 
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A second linearly independent solution of this equation is provided 
by the function J_,(x) (% not an integer), so that the general solution 
has the form 


y = Cyn (x) + Con), 


where C, and C, are arbitrary constants. The recurrence formulae 
(6.605)—(6.609) also hold for J,(x), where 7 is not an integer. 
Bessel functions of the first kind J  ,(x), where 7 is an integer, 


n+— 
2 


are expressible in terms of elementary functions; in particular, 


1 
2 — 1) 2s 
0-8 Srifboay 
2 vend +s+1) 
: ee 2x sinx _ eee 
eta Y sept = mt x Vax 7” 


(6.611) 


2 
7 i 1 (x) = |— cos x: (6.612) 


Expressions for J__, (x), n any integer, can be obtained by successive 
n+5 
2 
applications of the recurrence formulae. 
Bessel functions of the second kind Y,(x) (Weber functions) are 
expressible in terms of Bessel functions of the first kind with the aid 
of the equations: 


Ye tin J,(x) cos vx — J_,(x) 


rea ae for m an integer (6.613) 


_ Jy(x) cos nt — J_»(x) 

Y A(X) = en eg for n not an integer. (6.614) 

Like J,(x), the function Y,(x) satisfies the differential equation 

(6.603), the general solution of which has the form, when 7 is an inte- 
ger, y = C,J,(x) + C.Y,,(x). 
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The Macdonald function is usually taken as the second solution of 
equation (6.604): 


af I_,{(x) na T(x) 


5 a for m not an integer. (6.615) 


- K(x) = 


The recurrence formulae are: 


Ynai(®) = Yul) - Yao): (6.616) 

Yna1(%) = — Ya(x)+ Yas); (6.617) 

Yn) = 5 nai 2) Yass (6.618) 

Yaa (2) + Yaa (x) = — Yq (2); (6.619) 

Ingi()— Ina) = —2 2); (6.620) 
2n 

Kn41(X) — Ky_a(x) = as n(x). (6.621) 


Relationships between Bessel functions of the first and second 
kinds are: 


J¥na@)- Yann) = 3 (6.622) 


Iy(2)Kyx(2) + Kang x02) = (6.623) 


Representations as series are: 


2 4 6 
Io(x) = 1-(F) ae (F) -an(F) ee (6.624) 
1/x\? 1 5 
he -3i(¥) +ai(3] —sa(F 


= tees (6.625) 
Y,(x) = z (e+ 5) Io(x)— —o — @i y z : (6,626) 
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2 2 
1 2 (— 1)" x \enrt1 n ] if 
~ a ky WG DE (=) (2 Jeti) pee 
w\e.. 1 fx \*... 1 
x 1/x\ 1 f/x\® 1 /x\’ 
L(x) = star(F) +a Z| ‘sala a (6.629) 
K C+in~) I(x + F ee 6 
(x) = -( + 3) H+ 3x7) y E? (6.630) 
K,(x) a (c+i Z| ho) +— _ 


oe 1 x \2n+1 /nt1 |] 1 
~ 2, revit =) (eo ma) ae, 


where C is Euler’s constant (see § 1, sec. 1, 3°). 
Asymptotic formulae (for large values of x) are: 


sa) ~ [2 | race) sin (x42) +0400 co8( 24% 
Z . 0 4 

J(x) = j= - sin (4) +Q,(x) cos (wa 
2 


7X 
Yi(x) = Jz — fF — P;(x) cos (: ~_ i +(Q,(x) sin (. 


where 


; (6.632) 


i : (6.633) 


17.3? 12,3°.5°:77 


Pox) = 1-sTgt aie ; 
] 17.32.52 

Ql) = ~ TET 31(8xe 
12.3.5 12,32,52.7.9 

P(x) = 1+ 


(ax alex 


13. — 12,3.5.7 . 
AC) = Te tea to 
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2 2 22 2 22 <2 
Lee eae a (6.636) 
Bx 2!(Bx)? 31(8x)? 
2 2 22 
Be ee LL CY 
8x 21(8x)®? 31(8x) 
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Fic. 18. Bessel functions of the first kind J,(x), J3(x), J3(x), Jy_(x). 
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y= %(x) 


2 x 


Fic. 20. Bessel functions of the Fic. 21. Bessel functions of the 
first kind J,(x) and 2,(x). second kind K,(x) and K,(x). 


ke (Ee ey Ok ee 
K,(x) = e J = (1 Ce Gor Tene See | (6.638) 
gee. Cae ic ee roe a 
as z (1+: Dex 31(8x)8 
(6.639) 


Graphs of Bessel functions are shown in Fig. 17, 18, 19, 20 and 21. 


NOMENCLATURE 


(a b) — The interval ax x<b 

[— -,a@) — The infinite interval x<a 

[6, + ~) — The infinite interval x>6 

[a,b] — The segment az x=xb 

(a, b}] — The semi-interval a<x=ab 

[a, b) — The semi-interval asx<b 

(— ~-,a] — The infinite semi-interval xsa@ 

{b, + ~) — The infinite semi-interval x =b 

{x,} — The set of elements x, 

x € X — The element x belongs to the set XY 

x€X or x ¢ X — The element x does not belong to the set Y 

XcY — The set X is a subset of the set Y 

XcYorXe¢ Y — Theset X is not a subset of the set Y 

AUB or A+B — The union (sum) of sets A and B 

Aon BB, or AXB, or A» B or AB— The intersection (product) of sets A and B 
B\A or B—A — The complement of the set 4 with respect to the set B 


x — Thestrict upper bound of the set _Y 

a f(x) — The strict upper bound of the function fon the set X 
vt x — The strict lower bound of the set 
ey (x) — The strict lower bound of the function f on the set X 


max {4,, az, ..., @,} — The greatest of the numbers a,, a;,..., a, 


min {a,, a, ..., @,} — The least of the numbers a,, @,, ..., 4 


n 
Pe = {a,, az, ..-, G,, ...} — The sequence with the general term a, 
a,,,} —- A double sequence 
o(@,) — a, is an infinitesimal of lower order with respect to #, if 8, =O(a,) 
O(a) — a, has a rate of decrease not faster than #, 
o{x), O(x) — Orders of the function x 
lim f(x) — The limit of the function f(x) as x + x5, x ¢€ X 
xX—>X, XEX 
E, — One-dimensional coordinate space (numerical axis) 
E,, — n-dimensional coordinate space 
E,+£,_,; — The direct sum of manifolds 
o(X, Y) — A distance 
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9 (0, 0, ..., 0) — The origin of coordinates 
Sf(X) =f(%1, Xe, -.., X,) — A linear function, or a function of a vector (point) 
\| X |] — The norm of the vector X 
Ix, 12... X_ ~ Gram’s determinant for vectors 
L, ~ n-dimensional linear system 
X | &E, — The vector X of E, is orthogonal to E, 
prs,X — The projection of the vector X on to E, 
przg,X — The projection of the vector X on to the vector U, 
lim f(X) — The limit of the function f(X), when X¢€M tends to A 
X—> A(X € M) 
Q, — The exterior domain 
Q,— The interior domain 
F = (fi, fey -++> Sn) —AnD Operator 
Y= F(X) — The vector form of writing an operator 
Ye = FIMX) = fey, Xo, ...5 X,) — The coordinate form of writing an operator 
Ve ™ Ay X + QgXa+ ... +4;,X%, (i = 1, 2, ..., m) — The coordinat> form of 
writing a linear operator 
Eng — The space with norm p(X) 
Eas = Ene — The space E,» is conjugate to the space E,, 
Pa = PP +>Pm — the mth partial product 
{P,,} - The sequence of partial products 


Tm = PmsiPmen ss = I] P, — The remainder product 
ss r=em+1 
> a, — A double series 

k,l =Q 

R — The radius of convergence of a power series 

r,(x) — The remainder term of the Taylor series 


F(x) ~ }° A,/x* — The asymptotic expansion of the function F(x) 
k=0 


a 
and g(x 


\|/|}| —The norm of a function 


b 
(fig) = | S(x)g(x) do(x) — The scalar (inner) product of the functions f(x) 


b 
I\sf-gii = | (f—g)? do(x) — The root square deviation of functions f and g 
a 


r, f(x) — The nth-order inverse derivative of /(x) 


+- — — 
ay ee ere ae are 
P,/Q, — The ath convergent of the fraction 


— A non-terminating continued fraction 


K, K — The ordinary and singular values of the same continued fraction 
C — The Euler—Mascheroni constant 
G — Catalan’s constant 
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n' — Factorial ” 

nt! — Double factorial n 

Onm OF O; Kronecker delta. 

(,) or Cy — The binomial coefficients 

P(x), P,(x), P(x) — Arbitrary orthogonal polynomials 

B, — Bernoulli numbers 

B,(x) — Bernoulli polynomials 

9,(x) = B,(x)—B, 

B,(f) — Bernshtein polynomials 

Lo(x), Lo(x). L°(x) — Laguerre polynomials 

L,(x), L(x), L,(x), 4, — Legendre polynomials 

T,(x), T(x), T(x) — Chebyshev polynomials of the first kind 
U,(x), U,(x), U(x) — Chebyshev polynomials of the second kind 
P, v(x) — Chebyshev polynomials with respect to a system of points 
E, — Euler numbers 

E,(x) — Euler polynomials 

H,(x), H,(x), H,(x) — Hermite polynomials 

Js Wx), Fr W(x), J Wx), 7% M(x) — Jacobi polynomials 
|x| — The absolute value of x 

sign x — The sign of x 

[x] or E(x) — The integral part of x 

{x} — The fractional part of x 

(x) — The distance to the nearest integer 

1(x) — Heaviside’s unit function 

6(x) —The delta function 

Bia, £) — Euler’s beta function 

I(«) — Euler’s gamma function 

Ei(x) — The integral exponential function 

Ei(x) — The real part of Ei(x) 

lix — The integral logarithm 

si (x) or Six — The integral sine 

cix or Cix —The integral] cosine 

erf x, p(x), @»(x), erfc x, L(x) — The error function. 

F(k, gy) — The elliptic integral of the first kind 

E(k, vy) — The elliptic integral of the second kind 

II (k, A, ~) — The elliptic integral of the third kind 

Dk, ¢) — [F(k, gp) — Ek, @)]/k? 

K — The complete elliptic integral of the first kind 

E ~— The complete elliptic integral of the second kind 

D = (K—-E)/k? 

wa), (x) — The logarithmic derivative of the gamma function (the psi functions) 
S(x), S*(x) — The Fresnel sine integral 

C(x), C*(x) — The Fresnel cosine integral 


NOMENCLATURE 


J,(x) — Bessel function of the first kind 

Y,(x) — Bessel function of the second kind 

I(x) — Bessel function of an imaginary argument 
K,(x) ~ Macdonald function 
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